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FOREWORD 


IMs  report  vas  prepared  by  Purdue  University  under  USAF  Contract 
Number  A?  33(657 )-10709.  The  contract  vas  initiated  under  Project  4335, 

"(U)  Applied  Communications  Research  for  AF  Vehicles, "  Task  433529,  "Basic 
Techniques  and  Systems  Integration."  Hie  work  vas  administered  under  the 
direction  of  the  Cocununi cations  Branch,  Electronic  Warfare  Division,  Air 
Force  Avionics  Laboratory,  Wright-Patterson  Air  Force  Base,  Ohio. 

Mr.  B.  W.  Russell  vas  project  engineer. 

Dr.  John  Hancock,  Purdue  University,  vas  the  Principal  Investigator 
on  the  contract.  Hiis  report  covers  vork  conducted  from  February  1963  to 
December  1964. 

The  first  volume  in  this  series  is  a  tutorial  overview  of  the 
several  problem  areas  investigated  under  this  effort  and  serves  to  integrate 
and  place  in  perspective  the  more  detailed  analysis  presented  in  succeeding 
volumes.  The  relation  of  this  Volume  IV,  "Distribution-Free  Detection  Pro¬ 
cedures,"  to  the  overall  program  may  be  obtained  by  referring  to  Volume  I. 

Throughout  the  course  of  this  vork,  the  principal  investigators  have 
benefited  from  the  several  discussions  vith  Mr.  Blinn  W.  Russell,  the  pro¬ 
ject  monitor,  and  his  associates.  His  interest  in  this  vork  is  gratefully 
acknowledged. 
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ABSTRACT 


A  da  38  of  two -Input  detection  system*  for  digital  co— ml  cation  ever 
r&ndoa  and  unknown  channels  is  investigated.  The  systems  investigated  possess 
false-alar*  rates  which  are  invariant  for  vide  classes  of  channel  statistics. 

Specifically,  coincidence  detection  procedures  with  invariant  or  distri¬ 
bution-  ffcee  false-darn  rates  are  proposed  and  investigated.  The  only  infor¬ 
mation  concerning  the  channel  statistics  which  is  required  by  these  detectors 
is  the  median  of  the  noise  under  no-signal  conditions.  The  coincidence  pro¬ 
cedures  are  subsequently  modified  so  that  the  detectors  utilizing  them  become 
either  learning  systems  with  respect  to  slowly  time-varying  and/or  'nknown 
location  parameters  or  adaptive  systems  with  respect  to  rapidly  varying  and/or 
unknown  location  parameters.  The  classes  of  detection  problems  for  which 
the  false-alar*  rates  of  the  above  procedures  detectors  remain  distribution-free 
are  also  obtained. 

In  addition  to  the  distribution-free  coincidence  detectors,  a  detector  j 

5 

? 

based  on  the  T- statistic,  and  well  suited  for  the  detection  of  stochastic 

i 

signals  in  noise,  is  proposed  and  Investigated.  The  T-statistic  is  then 
modified  so  that  the  detector  utilizing  it  becomes  an  adaptive  system  with 
respect  to  rapidly  varying  and/or  unknown  location  parameters.  The  vide 
classes  of  detection  problems  for  which  the  above  detectors  remain  distri¬ 
bution-free  are  also  obtained. 

The  distribution- free  detectors  are  then  applied  to  various  practical 
detection  problems,  and  their  performances  are  evaluated  and  compared  to  the 
performances  of  comparable  likelihood  detectors. 


This  technical  documentary  report  has  been  reviewed  and  i  i  approved. 


LIONEL,*.  ROI 
Lt  Colonel, 

Chief,  Electronic  Warftre  Division 
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Chapter  1 
I1TR0DUCTI0I 

1.1  General  Background  of  Problea  and  Brief  Be^lev  of  the  Literature 

Systems  for  detecting  the  presence  or  absence  of  a  signal  in  noise 
hare  been  extensively  Investigated.  Many  of  these  investigations  have 
been  based  on  the  assumption  that  information  is  available  concerning  the 
probability  distributions  of  the  noise  only  and  of  the  mixture  of  signal 
and  noise.  The  distributions  are  usually  assumed  to  be  gsusslan,  and 
the  test  statistic  most  often  utilised  is  based  on  the  likelihood  ratio. 

In  order  for  the  latter  to  be  computed,  knowledge  of  the  font  of  the 
distributions  is  required. 

However,  the  statistics  are  not  always  known  or  readily  obtainable. 

In  many  practical  cases  of  Interest  -  such  as  subsurface  communications, 
underwater  sound  detection,  communications  under  jamming  conditions,  and 
space  communications  -  the  probability  distributions  may  not  be  known,  nor 
can  they  be  easily  obtained.  Extensive  statistical  studies,  such  as  those 
by  Pearson  and  Geyen  (1,2),  have  been  made  of  the  sensitivity  of  various 
likelihood  ratio  tests  to  non-normality. 

Since  likelihood  detectors  are  inapplicable  whenever  there  is  not 
information  concerning  the  functional  fora  of  the  underlying  distributions, 
and  since  it  is  not  possible  to  insure  a  specified  value  of  a  chosen  index 
of  performance  when  a  likelihood  detector  is  used  and  the  distributions 
are  not  known,  it  is  necessary  to  seek  detection  procedures  that  are 
invariant  in  some  sense  under  a  change  of  the  underlying  probability 
distributions  -  as  indicated  oy  Middleton  (3).  Such  procedures  may  be 
based  on  a  reference  or  control  sample  obtained  under  noise  only  conditions, 

Manuscript  feleased  by  authors  on  February  196 5  for  publication  as  an  RTD 
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which  can  be  coopered  with  a  sample  obtained  when  a  decision  is  to  be 
aade  on  the  presence  or  absence  of  signal.  In  other  words,  since  the 
received  data  cannot  be  described  by  distribution  functions  of  known  form, 
two  samples  can  be  utilized  -  the  leference  sample  obtained  when  it  is 
known  that  only  noise  exists  in  the  channel,  and  a  data  sample  obtained 
under  unknown  conditions  -  the  decision  being  based  on  comparison  between 
the  two  samples.  Since  random  processes  are  being  dealt  with,  this  com¬ 
parison  must  be  a  comparison  of  statistical  properties.  The  logic  behind 
this  approach  is  based  on  the  assumption  that  the  presence  of  a  signal  will 
cause  a  difference  to  exist  between  the  statistics  of  the  reference  and 
data  samples . 

Capon,  Groginsky,  Rush forth,  Hancock,  Wolff  and  Kane f sky  have  all 
rather  recently  applied  distribution- free  statistical  tests  to  the  detec¬ 
tion  problem. 

Capon  (4, 5,6)  has  applied  many  tests  to  the  detection  problem,  such 
as  the  Mann-Whitney,  the  Wald-Wolfowitz,  the  Kolmogorov- Simirncnr  and  the 
rank  order  tests.  Of  these,  the  only  ones  of  interest  to  the  communica¬ 
tions  engineer  are  the  highly  efficient  Mann-Whitney  and  the  rank  order 
tests.  However,  in  order  for  the  rank  order  statistic  to  be  applied  to  a 
specific  detection  problem,  weighting  factors  must  be  known.  The  informa¬ 
tion  on  these  weighting  factors  cannot  be  obtained  unless  the  noise  distri¬ 
bution  is  known  and  even  then  the  factors  are  often  difficult  to  compute. 
Thus,  the  rank  order  tests  as  treated  by  Capon  are  not  truly  distribution- 
free.  The  Mann-Whitney  test,  though,  is  distribution  free. 

Groginsky  (7)  proposed  procedures  whereby  the  weight  function  of  the 
rank  order  detector  is  determined  from  the  outcome  of  previous  trial  of  the 
detector,  thus  effectively  removing  the  necessity  of  knowledge  concerning 
the  distributions.  The  ability  of  such  a  detector  to  obtain  the  required 
weight  function  for  a  wide  class  of  distribution  functions,  and  to  follow 
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changes  in  the  structure  of  the  signals  and  noise,  constitutes  its 
adaptlre  feature.  Stability  and  performance  of  rarious  schemes  to  update 
the  weight  function  were  also  studied. 

Rush forth  (8)  re-examined  rank  order  tests  and  obtained  results  of 
practical  importance  for  detection  problems .  Hancock  (9)  re-examined  the 
Mann- Whitney  test  and  obtained  results  for  non-gaussian  noise  statistics. 

Wolff  (10)  pointed  out  that  the  polarity  coincidence  correlator  is 
non-paraaetrlc  in  that  the  false-alarm  rate  depends  only  on  the  median  of 
the  noise.  The  latter  van  assumed  to  be  zero.  However,  the  assumption  of 
zero  median  for  the  noise  nay  not  always  be  a  realistic  assumption,  in  which 
case  this  test  is  no  longer  distribution- free. 

Kane f sky  (11)  subsequently  showed  that  the  effect  of  a  non-zero  median 
on  the  polarity  coincidence  correlator  was  removed  when  an  adaptive  procedure 
to  set  the  threshold  level  for  inputs  with  quasi-stationary  medians  -  such 
as  described  by  Eykhoff  (12)  and  Zadeh  (13)  -  was  employed.  The  modified 
polarity  coincidence  correlator  was  then  applied  to  various  detection 
problems  of  practical  importance  and  its  performance  compared  to  that  of 
various  optimum  and  suboptlmum  detectors. 

From  the  citings  of  the  above  literature,  it  is  seen  that  there  have 
been  numerous  investigations  of  the  applicability  of  various  distribution- 
free  tests  to  the  detection  problem.  However,  the  previous  investigations 
by  no  means  exhaust  the  subject.  There  are  many  very  premising  distribu¬ 
tion-free  tests  that  have  not  been  previously  investigated  from  the  detec¬ 
tion  theory  standpoint.  Some  involve  the  use  of  coincidence  detection 
procedures.  These  coincidence  procedures  for  detecting  the  presence  or 
absence  of  a  signal  in  noise  have  been  studied  extensively  by  Harrington 
(14),  Schwartz  (15),  Capon  {l 6),  and  Ikmimovich  (17).  The  detectors  used 
choose  a  threshold  level  and  count  the  number  of  observations  that  exceed 
this  level.  On  the  basis  of  this  number,  the  detector  decides  whether  or 
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not  there  Is  a  signal  present.  In  earlier  Investigations  of  coincidence 
procedures,  the  threshold,  was  chosen,  on  the  basis  of  intuition  and  engineering 
judgment,  to  he  the  mean  of  the  input  waveform  under  no-signal  conditions. 

Ibis  choice  of  threshold  leads  to  a  suboptimum  coincidence  procedure.  Later, 
an  analytical  and  more  sophisticated  approach  to  the  subject  was  taken,  and 
optima  coincidence  procedures  were  obtained  for  weak  signals  in  noise.  The 
optimum  coincidence  detection  procedure  chooses  the  threshold  level  in  such 
a  aanner  that  it  requires  the  minimum  input  signal- to- noise  ratio  to  insure 
a  specified  information  rate  and  error  probability.  Some  investigators 
have  obtained  the  optimum  coincidence  detector  for  particular  detection 
problems  by  means  of  a  point-by-point  graphical  procedure.  However,  it 
must  be  emphasized  that  to  obtain  the  optimum  threshold,  complete  knowledge 
of  the  first-order  probability  distributions  under  signal  and  under  no¬ 
signal  conditions  is  required.  Moreover,  the  threshold  is  optimum  only  for 
the  particular  detection  problem  for  which  it  was  obtained. 

In  general,  the  coincidence  detection  procedures  proposed  in  the  past 
are  parametric  procedures  -  and  hence  inapplicable  whenever  the  probability 
distributions  are  unknown.  They  are  optimum  for  a  particular  datactlon 
problem  for  which  they  have  been  obtained  and  become  suboptimum,  if  not 
useless,  under  different  circumstances.  The  most  important  drawback  of 
the  parametric  coincidence  procedures  in  the  face  of  unknown  distributions 
is  their  inability  to  specify  and  guarantee  the  attainment  of  a  desired 
value  of  a  specified  index  of  performance,  such  ae  false-alarm  rata*  Thus, 
a  need  exists  for  coincidence  detection  procedures  that  are  applicable  when 
the  distributions  are  unknown  and  that  possess  an  index  of  performance 
invariant  under  changes  in  the  statistics  of  the  detection  problem. 
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1.2  General  Assumptions 

The  cardinal  assumptions  on  which  this  investigation  is  based  oust 
be  emphasized.  These  are  a)  that  two  sample  functions  are  available;  and 
b)  that  Independent  samples  can  be  obtained  from  the  two  sample  functions 
without  knowing  the  underlying  probability  distributions.  In  addition,  all 
the  investigations  are  restricted  to  the  detection  of  weak  signals  in  noise. 
Comparisons  between  nonparametrlc,  or  distribution-free  detection  procedures, 
and  parametric  ones  are  made  cm  the  basis  of  the  concept  of  asymptotic 
relative  efficiency  which  is  a  measure  of  relative  information  rate  for 
specific  error  probability. 

1.3  Methods  and  Procedures 

In  this  investigation,  two  distribution-free  test  statistics  axe 
utilized;  these  are  characterized  by  simplicity,  lack  of  severe  restrictive 
assumption,  and  high  efficiency.  They  consist  of  the  sign,  or  median,  test 
statistic  and  the  T- statistic.  The  first  is  well  suited  for  the  detection 
of  deterministic  signals  in  noise,  while  the  T-statistlc  is  well  suited  for 
the  detection  of  stochastic  signals  in  noise. 

The  sign  test  statistic  as  used  here  constitutes  a  coincidence  detec¬ 
tion  procedure.  In  this  investigation,  coincidence  detection  procedures 
with  invariant  false-alarm  rates  for  a  wide  class  of  distribution  functions 
are  proposed  and  investigated.  Conditions  under  which  the  coincidence  pro¬ 
cedures  remain  distribution- free  are  also  obtained.  The  detectors  based 
on  the  distribution- free  coincidence  procedures  are  then  applied  to  various 
detection  problems  of  practical  importance;  their  performance  in  the  prob¬ 
lems  is  evaluated  and  compared  to  that  of  likelihood  detectors. 

In  the  distribution- free  coincidence  procedures  investigated  here,  the 
threshold  is  chosen  so  that  the  test  statistic  possesses,  under  no-signal 
conditions,  a  known  distribution  with  constant  and  known  mean  and  variance, 
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independent  of  the  statistics  of  the  detection  problem.  The  invariant 
nature  of  the  test  statistic  distribution  under  no-signal  conditions  insures 
a  false  alarm  rate  invariant  vith  respect  to  changes  in  the  channel  statistics. 
The  threshold  is  chosen  to  be  a  specified  noise  distribution  quantile, 
namely,  the  median  (recalling  that  the  "median"  is  the  point  at  which  the 
cumulative  distribution  is  0.5)  -  hence  the  name  "median  detector"  for 
the  distribution- free  coincidence  procedure.  It  must  be  noted  that  to 
employ  the  median  detector,  the  median  of  the  noise  under  no- signal  condi¬ 
tions  must  be  known.  The  latter  is  the  only  Information  concerning  the 
channel  statistics  required  by  the  median  detector.  Since,  in  many  detec¬ 
tion  problems  of  interest,  even  this  minimal  information  concerning  the 
channel  statistics  may  not  be  available ,  the  median  detector  1b  made  a  lear¬ 
ning  system  with  respect  to  the  unknown  median  ftr  a  wide  class  of  distri¬ 
bution  functions.  Thus,  a  learning  procedure  is  herein  proposed  and  inves¬ 
tigated  whereby  the  threshold  is  adjusted  to  maintain  an  invariant  false- 
alarm  rate  even  in  the  case  (f  an  unknown,  stationary  or  qua si -stationary 
noise  median.  The  conditions  under  which  the  learning  median  detector 

s 

remains  distribution- free  are  obtained.  The  learning  median  detector  is 
then  applied  to  a  gausaian  and  to  a  noa-garssian  situation  of  practical 
importance,  and  its  performance  and  learning  efficiency  are  evaluated 
and  compared  to  the  performance  and  learning  efficiency  cf  likelihood 
detector » 

The  median  detector  is  also  made  adaptive  to  rapid  changes  in  the 
structure  of  the  noise  for  a  wide  class  of  distribution  functions;  that  is, 
an  adaptive  procedure  is  proposed  and  investigated  whereby  the  threshold 
is  adjusted  to  maintain  an  invariant  false- alarm  rate  even  for  non- sta¬ 
tionary  noise  medians.  The  .mnditi-.ns  .inier  which  th®  adaptive  median 
detector  remains  distribution-free  are.  obtained.  The  adaptive  median 
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detector  Is  then  applied  to  vari-me  detection  problems  and  its  performance 
Is  evaluated  and  compared  to  that  of  other  distribution-free  detectors  and 
to  that  of  likelihood  detectors. 

In  this  investigation,  the  T- statistic,  an  efficient  test  statistic 
for  the  detection  of  changes  in  variance,  is  applied  to  the  problem  of 
detecting  stochastic  signals  in  noise.  The  conditions  under  which  the 
T- statistic  remains  distribution-free  are  obtained.  To  employ  the 
T- detector  based  on  the  T-statlstlc,  the  medians  of  the  noise  in  the 
reference  and  data  channels  must  be  known.  The  T-detector  is  applied  to 
a  detection  problem  of  practical  importance,  and  its  performance  in  the 
problem  is  evaluated  and  compared  to  the  performance  of  the  equivalent 
likelihood  detector. 

The  T-detector  is  also  made  adaptive  to  changes  in  the  structure  of 
the  noise  for  a  vide  class  of  distribution  functions;  that  is,  an  adaptive 
procedure  is  proposed  and  investigated  by  means  of  which  the  threshold  is 
adjusted  to  maintain  an  Invariant  false-alara  rate  when  the  noise  medians 
are  rapidly  changing  and/or  unknown.  Conditions  unddr  which  the  adaptive 
T-detector  remains  distribution- free  are  also  obtained.  The  adaptive 
T-detector  is  then  applied  to  the  detection  of  a  gnus si an  signal  in 
gaussien  noise  and  its  performance  in  the  problem  evaluated  and  compared 
to  the  performances  of  the  T-detector  and  optimum  likelihood  detector. 

1.4  Preview  of  Subsequent  Chapters 

In  Chapter  2,  the  detection  criterion  utilized  in  this  investigation 
and  the  assumptions  on  tbich  it  is  based  are  discussed.  The  rerJULzability 
of  the  assumptions  i  shown.  In  the  same  chapter,  suitable  means  for 
comparing  the  distribution-free  and  likelihood  detectors  are  proposed  and 
their  physical  significance  discussed. 

In  Chapter  3,  coincidence  detection  procedures  with  invariant  false- 


alar*  rates  for  a  vide  class  of  distribution  functions  are  proposed.  In 
particular,  the  median  detector,  based  on  a  specific  distribution- free 
coincidence  procedure,  is  investigated  and  its  general  properties  obtained. 
Subsequently,  the  median  detector  is  applied  to  various  detection  problems 
of  practical  importance;  its  performance  is  evaluated  and  compared  to  the 
performance  of  likelihood  detectors. 

In  Chapter  the  median  detector  is  made  a  learning  system  with 
respect  to  unknown  stationary  or  quasi  stationary  medians.  Conditions 
under  which  the  learning  median  detector  false-alarm  rate  remains  distri¬ 
bution-  free  are  also  obtained.  Subsequently,  the  learning  median  detector 
is  applied  to  wo  detection  problems  of  practical  importance  and  its 
performance  and  learning  efficiency  are  evaluated  and  compared  to  the 
performance  and  learning  efficiency  of  likelihood  detectors. 

In  Chapter  5,  the  median  detector  is  made  adaptive  to  non- stationary 
noise  medians.  Conditions  under  which  the  adaptive  median  detector  false- 
alarm  rate  remains  destribution-free  are  obtained.  The  adaptive  median 
detector  is  then  applied  to  various  detection  problems  and  its  performance 
is  evaluated  and  compared  to  that  of  likelihood  detectors. 

In  Chapter  6,  detection  based  on  the  T-statistic  is  investigated  and 
its  general  properties  examined.  Conditions  under  which  the  T-detector 
false-alarm  rate  remains  distribution- free  are  also  obtained.  The  T- 
detector  is  then  applied  to  the  problem  of  detecting  a  gaussian  signal 
in  gaussian  noise,  and  its  performance  in  the  problem  is  evaluated  and 
compared  to  that  of  a  likelihood  detector. 

In  Chapter  7>  the  T-detector  is  made  adaptive  with  respect  to 
rapidly  changing  and/or  unknown  data  and  reference  channel  noise  medians. 
The  conditions  under  which  the  adaptive  T-detector  false-alarm  rate 
~<?mains  distribution- free  are  obtained.  The  adaptive  T-detector  is 
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then  applied  to  the  detection  of  a  gausslaa  signal  in  gausslaa  noise 
and  its  performance  is  evaluated  and  compared  to  that  of  a  likelihood 
detector. 

In  Chapter  8,  conclusions  are  drawn  and  areas  for  future  vark  are 
Indicated. 
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Chapter  2 

GENERAL  COKSIEERATIOHS 


2.1  Introduction 

In  this  chapter,  the  detection  criterion  utilized  in  this  investigation 
and  the  assumptions  on  which  it  is  based  are  presented  and  discussed.  It  is 
shown  that  the  assumptions  are  reasonable  and  the  conditions  implied  are 
realizable,  under  certain  conditions. 

In  the  weak  signal  case,  the  test  statistics  employed  here  obey  a  set 
of  regularity  conditions.  These  are  stated  and  their  significance  is 
discussed.  A  performance  relation  which  has  been  previously  derived  from 
the  regularity  conditions  is  also  presented.  Fbr  a  given  detection  problem, 
it  relates  the  information  rate,  signal- to-noise  ratio,  and  the  error  proba¬ 
bility  to  a  constant  which  is  characteristic  of  the  detector  used.  Thus, 
the  above  constant  may  be  utilized  as  an  index  of  performance  of  the 
detection  system. 

For  comparing  the  distribution- free  detectors  to  their  equivalent 
likelihood  detectors,  suitable  means  are  proposed  and  their  physical  signi¬ 
ficance  discussed.  These  are  the  asymptotic  relative  efficiency  and  the 
detector  output  signal- to- noise  ratio.  The  asymptotic  relative  efficiency 
is  shown  to  be  a  measure  of  the  relative  information  rate  for  a  specified 
error  probability  and  vanishing  input  signal -to-noise  ratios.  The  output 
sign*  1- co- noise  ratio  is  defined  to  be  the  difference  between  the  means  of 
the  test  statistic  under  no- signal  conditions  divided  by  the  variance  of 
the  statistic  under  signal  conditions.  It  is  shown,  for  the  weak  signal 
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case  treated  here,  that  the  output  signal -to- noise  ratio  as  defined  above 
is  functionally  related  to  the  error  probability.  The  exact  functional 
relation  is  also  given. 

2.2  The  Detection  Criterion 

The  detection  criterion  utilized  in  this  investigation  is  based  on 
the  following  assumptions .  It  is  assumed  that: 

a.  it  is  possible  to  obtain  a  sample  function  N(t)  of  the  noise 
random  process  (H(t)},  H(t)  hereon  to  be  referred  to  as  the 
reference  sample  function; 

b.  it  is  possible  to  obtain  a  sample  function  Y(t)  of  the  channel 
output  stochastic  process  (Y(t)},  Y(t)  hereon  to  be  referred  to 
as  the  data  sample; 

c  •  it  is  possible  to  obtain  n  independent  samples  Y^,  Yg,  . . .  Yr 

from  the  sample  function  Y(t)  and  m  independent  sample^  X^,  Xg, 

...  X  tram  the  sample  function  N(t); 
m 

d.  in  the  absence  of  the  signal,  {Y(t)}  and  {N(t )}  are  two  stochastic 
processes  of  identical  first  order  distributions 

On  the  basis  of  the  samples  Y^,  Yg,  ...  Yn  and  X^,  Xg,  . . .  Xffl,  a 
decision  procedure  for  detecting  deterministic  or  stochastic  signals  in 
noise  is  formulated  by  testing: 

Hq:  probability  distribution  function  (cdf)  of  Y^  is  Gq  (y),  1  *  1,2, 
..n  and  cdf  of  X^^  is  Fq  (x),  i  »  1,2,  .  •  .m  and  such  that  FQ(y)  * 
G  (y);  signal  is  absent 

against 

:  probability  distribution  function  of  Y^  is  (y)  and  that  of  X^ 
is  F  (y)  and  such  that  G  (y)  4  F  (y);  signal  is  present 


where  PQ(y)  is  tne  distribution  function  of  Xi  when  the  signal  is  present  or 

absent,  G^(y)  is  the  distribution  function  of  when  the  signal  is  absent, 

•nd  Gp  (y)  is  the  distribution  of  Y.  in  the  presence  of  signal-  It  is  to 

be  noted  that  G  (y>)  depends  both  on  the  inde*  i  end  z,  the  signal -to-noise 
0i 

rr.tio  parameter- 

The  above  decision  procedure  simply  rtates  that  if  the  signal  is 
absent,  then  the  distribution  of  Y^  must  be  the  same  as  the  distribution 
of  X1  since  both  were  obtained  from  stochastic  processes  of  identical 
first  order  statistics  under  no-signal  conditions.  If,  however,  the  signal 
is  present,  then  the  distribution  function  of  Y^  is  not  the  same  as  that  of 
X^  since  the  samples  Y  were  obtained  from  a  sample  function  of  the  signal 
and  noise  process  (Y(t)}  while  the  samples  were  obtained  from  a 
sample  function  of  the  noise  only  random  process (!l(t)} . 

From  the  previous  discussion  of  the  detection  criterion  and  its 
associated  assumptions,  it  is  obvious  that  the  acquisition  of  the  reference 
sample  function  from  the  noise  random  process  and  the  extraction  of 
independent  samples  from  the  data  and  reference  sample  functions  are  matters 
of  cardinal  importance. 

The  acquisition  of  the  reference  sample  function  may  be  accomplished 
in  various  ways  depending  on  the  nature  of  the  noise  process  and  the 
requirements  on  information  rate-  If  the  noise  process  is  stationary,  then 
N(t)  can  be  obtained  once  and  for  all  before  the  transmission  of  information 
commences.  From  N(t)  the  m  samples  will  then  be  obtained  and  stored  in 
the  receiver,  to  be  compared  later  with  the  n  data  samples  obtained  frem 
Y(t).  If  the  noise  random  process  is  quasi -stationary  —  that  is,  if  the 
noise  statistics  although  varying  with  time  do  so  rather  slowly  in  comparison 
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with  the  signaling  rate  —  then  one  obtains  the  a  noise  samples  free  the 
noise  entering  the  receiver  when  it  is  known  that  only  noise  exists  in 
the  channel,  and  uses  them  only  for  as  long  as  the  noise  process  remains 
stationary.  Whenever  the  noise  statistics  begin  to  change,  the  transaission 
of  information  must  be  interrupted  for  a  sufficient  time  to  enable  the 
receiver  to  collect  a  new  set  of  m  samples  to  be  used  for  as  long  as  the 
noise  remains  stationary.  The  previous  procedure  used  for  acquiring  the 
m  noise  samples  when  the  noise  statisllstics  are  quasi -stationary  requires 
knowledge  of  the  length  of  the  time  interval  for  which  the  noise  statistics 
are  stationary.  Such  knowledge  may  be  had  as  a  result  of  experimental  or 
theoretical  investigations.  Another  disadvantage  of  the  above  procedure 
is  that  it  requires  interrupting  the  transmission  of  information,  with  a 
consequent  reduction  in  information  rate.  If  such  reduction  of  information 
rata  is  undesirable,  or  if  knowledge  concerning  the  length  of  time  during 
which  the  noise  statistics  remain  stationary  is  not  forthcoming,  one  may 
employ  space,  angle  or  frequency  diversity  to  secure  a  channel  containing 
noise  only.  In  selecting  the  channels,  care  must  be  taken  to  insure  that 
the  first-order  noise  statistics  will  be  the  same  in  the  reference  and  data 
channels.  However,  even  after  a  careful  selection  of  the  reference  channel, 
it  is  still,  possible  that  differences  between  the  first  order  probability 
distributions  of  the  reference  channel  and  data  channel  noise  random  proc¬ 
esses  will  exist.  To  guard  against  erroneous  decisions  resulting  from  such 
differences,  two  of  the  test  statistic  treated  here  are  made  adaptive  to 
differences  in  noise  statistics  or  to  quasi-stationary  variations  in  the 
noise  statistics. 

If  the  channel  statistics  are  non- stationary,  that  is,  if  the 
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variations  in  statistics  occur  at  a  rate  comparable  to  the  signaling  rate, 
it  is  evident  that  one  must  ty  necessity  employ  diversity  m  order  to  secure 
a  reference  channel  and  a  data  channel  such  that  the  noise  processes  present 
in  the  channels  have  identical  first  order  statistics 

The  assumption  of  independent  samples  is  of  prime  importance  and  at 
the  basis  of  every  result  obtained  concerning  distribution-free  statistics. 
However,  despite  the  importance  attached  to  it,  no  sampling  procedure  has 
been  proposed  to  date  that  would  enable  one  to  obtain  independent  samples 
without  knowledge  of  the  statistics  of  “he  process.  The  statement  is 
usually  made  that  to  obtain  independent  samples  one  must  sample  infrequently. 
However,  no  quantitative  measure  has  teen  given  of  the  length  of  time 
between  samples  required  to  insure  the  independence  of  the  samples ,  Admittedly, 
the  subject  is  a  very  difficult  one.  A  premising  approach  to  the  problem, 
at  least  for  stationary  or  sufficiently  quasi-stationary  random  processes, 
may  be  found  in  distribution- free  tests  of  independence.  Distribution-free 
tests  of  independence  have  been  studied  extensively  in  the  statistical 
literature  (l8,19)>  The  tests  require  n  pairs  (x,  y)  of  samples  from  n 
continuous  distribution  function  ?(x,  y)  with  continuous  marginal  distribution 
functions  G(x),  H(y).  They  are  used  to  test  the  hypothesis  Hq:  F(x,  y)  = 

G(x)  H(y),  for  all  x,  y.  In  applying  the  tests  to  the  communication 
problem.,  one  would  obtain  the  sample  pairs  from  the  channel  output  sample 
function  as  shown  in  figure  1.  The  time  t  is  the  time  allowed  between 
samples  and  the  question  to  be  answered  is  whether  it  is  sufficiently  long 
to  insure  the  independence  of  the  samples-  It  is  seen,  from  figure  1,  that 
to  collect  n  paJ.rs  of  samples  (x,  y)  where  x  and  y  are  t  seconds  apart 
requires  considerable  time.  During  this  time  the  first  and  second  order 
statistics  of  the  process  must  remain  the  same  in  order  for  the  test  to 
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be  applicable  —  hence  the  necessity  for  stationarity  or  quasi-stationarity 
of  the  random  processes. 


xi  Ti 
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Fig.  1.  Sampling  for  Test  of  Independence 


2-3  Means  of  Comparison 

A  detection  theory  to  be  complete  must  a)  suggest  the  structure  of 
the  detection  system,  b)  specify  procedures  for  evaluating  the  performance 
of  a  particular  system,  and  c)  specify  means  for  comparing  varibua  systems. 
A  choice  of  one  of  the  many  distribution-free  test  statistics  specifies  the 
detector  structure.  Thus,  di stribut ion-free  detection  theory  fulfills  the 
first  of  the  above  requirements.  In  the  following,  means  for  evaluating 
the  performance  of  a  detector  and  means  for  comparing  it  to  the  performance 
of  other  detectors  will  be  given.  To  facilitate  the  presentation,  a  set 
of  regularity  conditions  that  the  detectors  investigated  here  obey  will  be 
stated  and  their  significance  discussed.  The  conditions  are: 


V  w 

(A)  - ~~"7g t —  is  asymptotically  gaussian  with  mean  zero  and  variance 

a0v  n' 

one  uniformly  for  0  in  the  closed  interval  [o,  a],  a  >  o,  a  (S  )  >  o, 

8  n 
o 

where  S  is  a  distribution- free  statistic  and  E«(S  ),  (S  )  are 
n  0  n  0  '  n 

its  mean  and  variance,  respectively. 

(B)  E’ (S  )  =  -  E  (S  )  exists  for  all  0  in  (o,  a),  and  is  continuous 

u  n  oy  0  n 


at  0  =  0.  , 

1  r  F  (S  )l  2 

(c)  umit  z  hp 

L  0  n 

n  00 


=  K  where  K  is  a  positive  constant; 


0=0 


(D)  there  exists  a  sequence  {0  }  suo.  that  limit  0=0 

n  n 

n  •  00 
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(S)  limit 
n  -  » 


°e(V 

W 


1 


(F)  limit  a02(SQ)  «  0 
n  -  * 


Condition  (A)  eimply  states  that  the  test  statistic  is  asymptotically 
gaussian  both  under  no-signal  conditions  (0  *  0)  and  under  signal  conditions 
(9  4  0).  Thus,  accoring  to  condition  (A),  the  general  character  of  the 
test  statistic  S  .  obtained  when  m  and  n  are  large,  is  shown  in  Fig.  2. 


Fig.  2.  Test  Statistic  Distributions  for  Large  Sample  Sizes 
Here  SQ  is  a  decision  threshold  chosen  to  insure  a  probability  of  false 
alarm  a.  The  parameter  8  is  the  false  dismissal  probability  and  1  -  £  is 
the  detection  probability.  Conditions  (B),  (C),  (E)  and  (F)  are  self- 
explanatory.  In  connection  with  condition  (C),  it  should  be  noted  that  K 
is  independent  of  the  number  of  samples  and  the  input  signal -to-noise  ratio 
parameter  8  .  It  depends  only  on  &  functional  of  the  noise  and  signal  and 
noise  only  distributions  and  the  particular  test  statistic  utilized. 

Condition  (D)  simply  states  that  ve  are  considering  a  sequence  of  alternatives 
which  approach  the  hypothesis  Hq  of  no  signal  present  as  the  number  of 
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sauries  increases.  The  sequence  of  alternatives  specified  by  bondition 
(D)  is  necessitated  by  a  desire  to  maintain  constant  detection  probability 
far  a  constant  false-alarm  probability  as  the  number  of  samples  increases. 

The  truth  of  the  above  statement  will  became  obvious  by  examining  Figure  2, 
and  applying  conditions  (E)  and  (F).  The  desire  to  maintain  constant 
false-alarm  and  detection  probabilities  as  the  number  of  samples  increases 
stems  from  the  fact  that  under  constant  false-alarm  and  detection  probabilities 
as  n  increases,  an  explicit  functional  relation  exists  for  comparing  the 
information  rates  of  two  detectors  under  identical  conditions.  This  will 
become  apparent  when  the  concepts  of  asymptotic  relative  efficiency  and 
output  signal -to-noise  ratio  are  discussed.  A  practical  consequence  of 
condition  (D)  is  that  any  result  obtained  based  on  the  above  conditions 
is  valid  for  vanishing  signal -to-noise  ratios. 

The  results  obtained  in  this  investigation  were  derived  on  the  basis 
of  the  aforementioned  regularity  conditions.  Thus,  a  restriction  of  the 
level  of  generality  was  made  by  considering  only  the  detection  of  weak 
signals  in  noise.  This  is  appropriate  since  the  weak  signal  case  is 
usually  the  least  amenable  to  solution  and  the  case  one  usually  desires 
to  solve  in  practice.  Moreover,  as  was  pointed  out  previously,  the  choice 
of  weak  signals  will  also  make  possible  explicit  functional  expressions 
for  the  means  of  comparisor . 

It  has  been  shown  (l6)  that  a  detector  based  on  a  test  statistic 
that  satisfies  the  regularity  conditions  possesses  for  large  sample  sizes 
a  performance  relation  given  • 


limit  K0n  =  2 
n 


erf”1  (1  -  2a)  +  erf"1  (l  -  20) 


(20-1) 


n  -»  oo 
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Ihis  relates  the  probability  of  error,  the  input  signal-to-noise  ratio  8^, 
and  the  number  of  samples  n  to  K.  The  constant  K  is  dependent  on  the  test 
statistic  and  the  statistics  of  the  detection  problem  under  consideration. 

The  importance  of  the  parameter  K  is  apparent.  It  har  veer  ca^ed  ~v  7  t,r.„  . 
(20)  the  efficacy  of  the  test  statistic,  and  it  may  be  utilised  as  an 
index  of  performance  for  the  detector  using  the  statistic.  It  will  be 
seen  subsequently  that  both  the  asymptotic  relative  efficiency  and  the 
output  signal-to-noise  ratio  are  functionals  of  the  efficacy. 

2.3*1  Asymptotic  Relative  Efficiency 

One  of  the  most  important  considerations  in  a  detection  problem  is 
the  length  of  time  required  to  detect  the  presence  or  absence  of  the 
signal  with  specified  accuracy  Ct  and  0,  since  the  signaling  rate  and  hence 
the  information  rate  depend  on  the  detection  time.  The  only  time  consumed 
by  a  distribution-free  detector  utilizing  a  data  and  a  reference  channel 
is  the  time  required  to  obtain  the  n  samples  from  the  data  channel.  If 
the  condition  of  independence  is  imposed  on  the  samples,  then  there  is 
a  limit  on  how  closely  one  may  sample  and  still  obtain  independent  samples. 
Hence,  the  number  of  samples  required  for  detection  is  inversely  proportional 
to  the  information  rate. 

A  detector  based  on  the  test  statistic  Sn  can  be  compared  to  the 

detector  based  on  the  test  statistic  L  on  the  basis  of  the  information  rate 

n 

* 

R  possible  with  vs.  the  information  rate  R  possible  with  for  the 
same  signal  in  the  same  environment  and  for  the  same  specified  probability 
of  error.  The  comparison  will  be  based  on  the  asymptotic  relative 
efficiency  (20,21,22)  defined  as: 
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R 
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n 
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(2.>2) 


where  n  are  the  samples  required  by  and  n  are  the  samples  required 
by  Sn  for  the  same  probability  of  error. 

If  the  test  statistics  satisfy  conditions  (A) -(F),  then  utilizing  the 
performance  relation  (2.3-l)>  we  obtain: 


ARE0  T  «  \  (2.3-3) 

S  ,  L 
n  n  K 

* 

where  K  and  K  are  the  efficacies  of  Sn  and  respectively,  defined  by 

condition  (c).  Thus,  the  asymptotic  relative  efficiency  is  in  this  case 

a  measure  of  how  much  better  is  the  information  rate  of  the  detector 

based  on  the  statistic  S  than  the  information  rate  of  the  detector  based 

n 

on  the  statistic  L  in  the  detection  of  the  same  weak  signal  in  the  same 

n 

environment  with  a  specified  error  probability. 


2*3-2  Slgnal-to-Noise  Ratio 

The  output  signal -to-noise  ratio  of  a  detector  based  on  the  test 
statistic  S  is  defined  to  be: 


r  s  >  W  -  W 

c  »>  — 


(2-5-**) 


As  a  consequence  of  condition  (B),  the  mean  value  theorem  (23)  may  be 
applied  to  obtrin 
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E*  (S  ) 
u  8  n7 

A 

e  -  e  _ 

where  0  <  0  <  0  .  Utilizing  this  result  in  Eq.  (2.3-^).»  we  have 
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(2-5-5) 


which,  as  a  consequence  of  the  continuity  of  e' (S  )  at  8  =  0,  and  conditions 

0  n 

(C),  (D)  and  {£),  can  be  rewritten  as 


limit 
n  -*  * 


e/nk 


(2.5-6) 


Thus,  it  is  seen  fro©  Eq.  (2-5-6)  that  the  output  signal -to-noise  ratio 
for  large  sample  sizes  and  vanishing  signal-to-noise  ratios  is  proportional 
to  the  input  signal-to-noise  ratio.  The  constant  of  proportionality  is 
a  function  of  the  sample  size  n  and  the  efficacy  K.  Again  the  importance 
of  the  detector  efficacy  is  evident. 

The  physical  justification  for  the  concept  of  output  signal-to-noise 
ratio,  as  defined  above,  becomes  apparent  if  one  studies  Fig.  2.  It  is 
observed  there  that  the  two  patterns,  signal  absent  and  signal  present, 
become  more  distinguishable  as  either  the  distance  between  their  central 
locations  (mean  values)  becomes  greater  or  the  concentration  of  their 
values  around  the  central  locations  becomes  greater  (smaller  variances). 

It  is  also  apparent  that  any  increase  in  distinguishability  between  the 
patterns  due  to  increased  distance  between  their  central  locations  will 
be  nullified  by  an  increase  in  variance .  The  same  xs  true  for  a  decrease 
in  variance  If  accompanied  by  a  decrease  in  distance.  Hence,  it  is  the 
ratio  of  distance  between  central  locations  of  the  two  patterns  to  the 
variance  of  the  signal  present  pattern  that  can  serve  as  a  measure  of  the 
distinguishability  of  the  patterns  or  detectability  of  the  signal  in 
noise,  in  the  sense  described  above.  In  fact,  the  output  signal-to-noise 
ratio,  as  defined  here,  is  a  measure  in  a  given  detection  problem  of  the 
false  dismissal,  probability  for  a  specified  false  alarm  probability. 


Thus,  the  output  signal-to-noise  ratio  serves  as  a  qualitative  measure 
of  the  detectability  of  the  signal  in  a  given  environment  utilizing  a 
specified  detector.  In  particular,  for  weak  signals  and  large  manber  of 
samples,  an  exact  expression  of  the  relation  between  the  probabilities  of 
false  alarm  and  false  dismissal  and  the  output  signal-to-noise  ratio  may 
be  derived  utilizing  Eq.  (2.3-6)  and  the  performance  relation  Eq-  (2-3-1) • 
The  functional  relation  between  output  signal-to-noise  ratio  and  false 
alarm  and  false  dismissal  probabilities  is 
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Chapter  3 
MEDIAN  DETECTOR 


Introduction 

Coincidence  detection,  procedures  base  their  decisions  on  the  presence 

or  absence  of  the  signal  on  the  following  test  statistic 

n 


S 

n 


(3.1-D 


i=l 


where  are  observations  on  the  input  waveform  Y(t),  and  x  is  the  threshold 
level.  The  function  c(z)  is  defined  as 


c(z)  «  1,  z  >  0 


0, 


z  <  0 


(3-1-2) 


The  mean  and  variance  of  S  under  no- signal  conditions  are 
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\  [c(Yi  -  x)] 
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1  00]  [F  00] 

O,  o. 


(3-1-^) 


where  Fq  (y)  is  the  probability  distribution  function  of  the  random  variable 

Y. 

The  test  statistic  £  is  equal  to  &  sum  of  independent,  binomially  dis¬ 
tributed  random  variables;  hence,  it  follows  from  the  central  limit  theorem 
(22)  that  Sn  is  asymptotically  gaussian  tinder  signal  and  under  no-signal 
conditions . 

For  large  number  of  sanqples,  the  distribution  of  S^,  being  gaussian, 
is  completely  specified  by  its  mean  and  variance.  In  turn,  the  false 
alarm  rate  of  is  completely  specified  by  the  distribution  of  the  test 
statistic  under  no-signal  conditions.  Thus,  for  an  invariant  or  distribution- 
free  false  alarm  rate,  the  mean  and  variance  of  Sr  under  no-signal  conditions 
must  be  constant,  and  independent  of  the  channel  statistics.  It  is  seen 
from  Eqs.  (3*1-3)  and  (3 -l-1*-)  that  if  the  threshold  level  x  is  chosen  as 
in  previous  investigations  (lU, 15, 16,17),  the  mean  and  variance  of  the 
test  statistic  Sr  will  vary  according  to  the  distribution  function  of  the 
noise  under  no-signal  conditions.  Thus,  the  false  alarm  rate  of  the 
coincidence  detection  procedure  will  also  vary.  For  the  reasons  stated 
in  Chapter  1,  the  latter  is  undesirable  when  the  channel  statistics  are 
unknown.  A  need,  therefore,  exists  for  coincidence  detection  procedures 


with  invariant  or  distribution-free  false  alarm  rates. 


26 


A  distribution-free  coincidence  procedure  results  if  the  threshold 
level  is  chosen  to  be  a  specified  noise  quantile  under  no-signal  conditions. 
Thus,  if  the  pth  quantile  z  is  chosen  as  the  threshold  level,  the  mean  and 
variance  under  no-signal  conditions  become 


*  IBJ 

o  n 


F  (z  )] [F  (zjj 


(3*1-5) 


(3*1-6) 


For  noise  with  stationary  quantile  z  under  no-signal  conditions. 


we  have 


Fq  (z^)  =  p,  i  *  I  2,  • • *,  n 

and  the  mean  and  variance  are  known  constants  given  by 


(3*1-7) 


Msnl  >  .  -  j  (3-1-8) 

Thus,  for  this  choice  of  threshold  level,  the  distribution  of  the  coincidence 
detection  procedure  test  statistic  Sn  is  asymptotically  known  and  inde¬ 
pendent  of  the  chanrel  statistics.  Hence,  the  coincidence  detection 
procedure  possesses  an  invariant  or  distribution-free  false  alarm  rate. 

To  utilize  the  distribution-free  coincidence  procedures  proposed  here, 
the  only  information  needed  concerning  the  channel  statistics  is  the  speci¬ 
fied  quantile  of  the  noise  under  no-signal  conditions. 

In  this  chapter,  a  particular  distribution-free  coincidence  detector  is 
proposed  and  investigated  in  detail.  It  utilizes  the  median  of  the  noise 
under  no-signal  conditions  as  its  threshold  level  —  hence  the  name  median 
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detector  for  this  coincidence  detection  procedure-  In  essence,  the  median 
detector  tests  for  the  presence  of  the  signal  by  testing  for  a  change  of  the 
median  of  the  input  waveform  Y(t),  the  assumption  being  made  implicitly 
that  such  a  change  in  median  is  the  result  of  the  presence  of  the  signal- 
In  the  following,  the  general  properties  of  the  median  detector  test 
statistic  are  obtained.  In  particular,  its  efficacy,  output  signal-to- 
noise  ratio,  and  performance  relation  are  obtained.  Subsequently,  the 
median  detector  is  applied  to  various  detection  problems  of  interest  and  its 
performance  is  evaluated  and  compared  to  that  of  likelihood  detectors. 

3-2  The  Median  Detector  Test  Statistic 

The  median  detector  as  defined  above  is  based  on  the  fo3 1  owing  test 
-statistic 

n 

sn(M)  -  ;  Y,  c(yi  "  M)  (3-2-1) 

i=l 

where  the  threshold  level  M  is  the  median  of  the  noise  under  no-signal 
conditions,  and  the  function  c(z)  is  defined  in  Eq.  (3*1-2).  Therefore, 
the  test  statistic  is  operating  on  the  input  waveform  Y(t)  in  the  same 
manner  as  the  system  shown  in  Fig.  3* 


> 


Fig.  3*  Block  Diagram  of  Median  Detector 
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The  median  M  is  subtracted  from  the  data  sample  function  Y(t);  the 
resulting  waveform  Z(t)  is  then  applied  to  an  ideal  half-wave  limiter 
the  output  of  which  is  sampled  n  times,  and  the  samples  averaged  to  yield 
S  (M). 

The  test  statistic  Sn(M)  decides  for  the  presence  of  the  signal  by 
testing  for  a  difference  between  the  median  of  the  data  sample  function 
and  M,  the  median  of  the  reference  or  noise  only  sample  function.  In 
effect,  the  median  M  serves  as  the  reference  sample  function. 

Stated  explicitly,  the  conditions  on  which  the  operation  of  the  median 
detector  is  based  are 

(a)  the  medians  of  the  reference  and  data  sample  functions  under 
no-signal  conditions  are  the  same; 

(b)  the  common  median  M  of  the  reference  and  data  samples  under 
no-signal  conditions  is  known. 

Condition  (a)  insures  that  any  difference  between  the  reference  and  data 
sample  function  medians  is  brought  about  by  the  presence  cf  the  signal. 
Condition  (b)  permits  the  calculation  of  the  statistic  Sn(M).  Both 
conditions  will  be  met  if  the  noise  under  no-signal  conditions  has  a  station¬ 
ary  median  and  the  reference  and  data  samples  are  obtained  from  the  same 
channel.  The  stationarity  of  the  noise  median  guarantees  that  the  reference 
and  data  samples  obtained  from  the  same  channel,  hence  from  the  same  sto¬ 
chastic  process  (N(t)}  under  no-signal  conditions,  will  have  the  same 
median.  The  particular  value  of  the.  median  can  be  obtained  by  taking 
measurements  foi  sufficiently  long  time  on  the  channel  before  the  trans¬ 
mission  of  information  commences,  so  that  the  true  value  of  the  median  is 


accurately  known.  This  value  of  the  median  may  be  used  for  all  time 
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thereafter  since  the  noise  median  is  stationary. 

The  disturbance  present  in  every  ccoraunication  channel  consists  (28)  of 
an  additive  disturbance  and  a  multiplicative  one,  the  latter  present  only 
under  signal  conditions.  Thus,  the  mild  restrictions  imposed  on  the  noise 
under  no  signal  conditions  are  restrictions  on  the  additive  noise  only. 

No  restrictions,  whatsoever,  on  the  nature  of  the  multiplicative  disturbance 
are  necessary  for  the  median  detector  to  possess  a  distribution- free  false 
alarm  rate. 

3*3  Median  Detector  General  Properties 

The  general  properties  of  the  median  detector  will  oe  obtained  for  the 
case  of  channel  statistics  that  sure  first  order  stationary  under  no-signal 
conditions.  Thus,  as  a  consequence  of  the  first  order  stationarity,  the 
randcan  variables  Y^,  ...,  Yr,  representing  the  amplitude  of  the  data 
waveform  at  the  sampling  instants  t^,  tg,  ...,  tQ,  are  identically  dis¬ 
tributed  with  a  common  distribution  FQ(y),  under  no-signal  conditions. 

Under  signal  conditions  and  in  the  presence  of  multiplicative  disturbance, 
the  continuous  parameter  stochastic  process  (Y(t ))  is  not  stationary  since 
the  signal  strength  at  the  receiver  is  varying  with  time.  Thus,  the  dis¬ 
tribution  functica  of  Y^  i  -  1,  2,  ...,  n  is  not  the  same  as  that  of 

Y.j  j  *  1,  2,  ...,  n,  j  f  i.  However,  we  shall  assume  that  the  distribution 
J 

of  Y^  i  =  1,  2,  ...,  n  differs  from  the  distribution  of  Yj,  j  «  1,  2,  ..., 

n,  j  f  i,  only  through  the  signal-to-noise  ratio  parameter  9;  i.e.,  the 

distribution  of  Y.  is  Gft  (y)  and  that  of  Y.  is  G.  (y) .  This  assumption  is 
1  ei  3  ej 

satisfied  in  many  detection  problems  of  interest. 

The  mean  and  variance  of  Sn(M),  under  no- signal  conditions,  are  given 

by  Eqs.  (3-1-8)  and  (3-1-9);  where  in  this  case 
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Therefore  the  mean  and  variance  are 


(5-5-1) 


Eo[Sn(M)]  -  i 


(5-5-2) 
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It  is  seen  that  the  mean  and  variance,  under  no-signal  conditions,  are 
known  and  constant,  independent  of  the  channel  statistics-  Thus,  the  median 
detector  false  alarm  rate,  as  explained  previously,  is  asymptotically 
distribution- free . 

However,  the  mean  and  variance  of  S^(M)  under  signal  conditions  do 
depend  on  the  channel  statistics.  Hence,  the  detection  probability  also 
depends  on  the  channel  statistics.  The  mean  of  sn(M)  under  signal  conditions 
is  given  by 
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Applying  the  mean  value  theorem  (25)  we  obtain 
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where  0  <  Q  <  0^,  and  because  of  the  first  order  stationarity  of  the  noise 
under  no-signal  conditions  Gq(M;  »  F  (MJ.  Substituting  this  result  in 


Bq.  ire  obtain 
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For  the  weak  signal  case,  Eq.  (3*3-6)  becomes 
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where  0  is  the  average  signal-to-noise  ratio 
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i=l 


(3-3-8) 
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The  variance  of  the  test  statistic  S  (h,’  under  signal  conditions  is 

n 


n 

°e2[sn(M)  ■  I  I  \  >c(Yi  - 


(3.3-9) 
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Utilizing  Eq.  (3 -3-5) >  vs  obtain 


u  C(S  tM)]  -  |  )  9.2 
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For  the  weak  signal  case,  this  becomes 


[S  (M)]  =  a  2[S  (H)]-  \  - 

6n  on  n2  d6  0  *  0 


(3-3-n) 


where  0  is  the  mean-square  value  of  the  signal-to-noise  ratio 


?.i  f  V 

n  [_>  1 


(3-3-12) 


It  is  to  be  noted  that  for  the  weak  signal  case  0  <  <  9. 

Utilizing  Eqs.  (3*3-3)  arid  (3*3-7);  we  obtain  the  efficacy  of  S  (M) 

r\  ** 
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(3.3-13) 
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The  test  statistic  S  (M),  being  the  sum  of  independent  binomially 

n 

distributed  random  ariables,  is  asymptotically  gaussian  under  signal 


<  ur  ier  no-signal  conditions;-  Thus,  it  satisfies  condition  (A). 


33 


Condition  (D)  is  fulfilled  in  the  weak  signal  case  investigated  here.  The 
existence  of  the  efficacy  given  in  Eq.  (3*3-13)  is  the  only  requirement 
for  the  statistic  to  satisfy  conditions  (B),  (C)  and  (E).  The  efficacy 
exists  for  all  continuous  parameter  stochastic  processes  with  continuous 
first  order  distributions.  It  is  seen  from  Eq.  (3*3-3)  that  Sn(M) 
satisfies  condition  (F)  always. 

A  test  statistic  is  said  to  be  consistent  if,  for  a  specified  false 
alarm  rate,  its  detection  probability  approaches  one  as  the  number  of 
samples  increases.  Conditions  (E)  and  (F)  establish  the  consistency  of 


S  (M). 
n 

Since  the  test  statistic  satisfies  conditions  (A)-(F),  its  performance 
relation  and  output  signal -to-noise  ratio  are  given  by 
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The  test  statistic  efficacy  may  also  be  used,  as  shown  in  Chapter  2, 
to  obtain  the  relative  information  rate  of  Sr(M)  with  respect  to  a 
likelihood  statistic.  Thus,  the  efficacy  given  in  Eq.  (3*3-13)  completely 
specifies  all  of  the  performance  indices  of  the  median  detector. 


3*4  Applications 

In  the  following,  the  median  detector  is  applied  to  specific  de¬ 
tection  problems,  its  performance  in  the  problem  is  evaluated  and  compared 
to  that  of  likelihood  detectors  applicable  to  the  problems. 


3*4.1  Detection  of  a  Sine  Wave  of  Known  Phase 
in  Additive  Noise  -  General  Case 


For  this  general  problem,  it  has  been  shown,  see  Eq.  (A-3)  in  Appendix 
A,  that 


d  Ge(y) 

d« 


e  *  o 


(3*4-1) 


Thus 

K[S  (M)]  »  4  f  2(M)  (3. 4-2) 

n  o 

The  efficacy  of  the  likelihood  detector  appropriate  for  the  problem  is 
given  by  Eq.  (B-25)  in  Appendix  B  as 

K*  -  1  (3.4-3) 


Therefore,  the  asymptotic  relative  efficiency  is 

(M),  L*  ■  u  f02(M)  (3-“-4) 

n'  "  n 

It  is  seen  from  Eq.  (3-4-4)  above  that  the  relative  information  rate  of 
the  median  detector,  with  respect  to  the  applicable  likelihood  detector 
for  this  general  problem,  may  be  anything  from  7,ero  to  infinity  depending 
on  the  probability  density  f  (y)  under  no-signal  conditions.  However, 
Hodges  and  Lehman  (29)  have  shown  that  for  a  probability  density  f  (; ) 
which  is  non-i"  /easing  on  either  side  of  its  median,  the  ARE  is  never 
less  than  1/3,  and  this  ewer  bound  is  attained  when  fQ(x)  is  rectangular. 


3-4.2  Detection  of  a  oine  Wave  of  Known  Phase  in  Additive  Gaussian  Noise 
This  problem  is  a  specific  case  of  the  previous  general  detection 
problem,  with  f  (y)  given  by  Eq.  (A-4)  as 
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"  «  <  y  <  » 


thus,  using  Eq.  (3-4-2)  we  obtain 


(3-4-5) 


KtS  (M)]  -  4  f  2(M)  (3*^-6) 
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The  asymptotic  relative  efficiency  is  obtained,  using  Eq.  (3 A-1*),  ** 


ABE. 


Sn(M), 


=  0.637 


(3-4-7) 


3-4-3  Detection  of  a  Sine  Wave  of  Known  Phase  in  Additive  Gaussian  and 
Impulse  Noise 

This  problem  also  is  a  specific  case  of  the  general  problem.  Hence, 
using  Eq.  (A-6)  in  Eqs.  (3-4-2)  and  (3-4-4),  we  obtain 


K[Sn(M)] 


and 


(3.4-8) 


(3-4-9) 


For  c  =  2,  we  obtain  the  asymptotic  relative  efficiency  for  gaussian  noise 
only.  This  is,  as  was  found  previously,  equal  to  0.64.  However,  for  c  ■  1, 
we  obtain  an  asymptotic  relative  efficiency  equal  to  2.00;  that  is,  for  a 
purely'  exponential  density  characterizing  the  additive  combination  of 
impulse  and  f.aussian  noise,  the  median  detector  is  twice  as  efficient  as 
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the  likelihood  detector  designed  under  the  gaussian  assumption.  The  latter 
is  a  significant  result.  It  points  out  that  in  the  presence  of  additive 
gaussian  and  impulse  noise  —  a  combination  found  in  many  channels  (ll,  24) 
it  is  advisable  to  utilize  a  median  detector  rather  than  a  likelihood 
detector  designed  under  the  likelihood  assumption. 


I ».4.l+  Detection  of  a  Sine  Wave  of  Unknown  Phase  in  Additive  Gaussian  Noise 
In  this  problem  we  have  from  Eqs.  (A-l4)  and  (A- 11)  that 
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(3*4-10) 


and  M  =  0  by  symmetry  of  fQ(y)  •  Thus,  using  Eq.  (3*3-13)  we  see  that 


K  =  4 


d  Gq(M) 
d0 


(3.4-11) 
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and  consequently 


ARE 


Sr  (K),  L 
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*  =  0 


(3*4-12) 


In  detecting  a  sine  wave  of  unknown  phase  in  additive  gaussian 
noise,  we  may  improve  the  efficiency  of  the  distribution-free  detector 
based  on  the  test  statistic  Sq(M)  by  proceeding  in  any  of  the  following 
ways.  We  may  discard  the  phase  information  by  predetection  processing 
the  incoming  waveform,  e.g.  envelope  processing;  or,  we  may  change  the 
specified  quantile  M  to  another  specified  quantile  so  that  the  detection 
efficiency  increases  and  the  detector  still  remains  distribution-free. 
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If  the  distributions  are  known,  then  ve  may  choose  the  threshold  so  that 
ve  maximize  the  ARE  (l6),  thus  obtaining  an  optimum  coincidence  procedure. 
However,  it  must  be  stressed  that  the  last  procedure  requires  complete 
knowledge  of  the  first-order  distributions.  Thus,  it  does  not  apply  to 
the  detection  problems  with  which  this  work  is  concerned. 


3*4.5  Envelope  Detection  of  a  Sine  Wave  in  Harrow-Band  Gaussian  Boise 
Since  the  phase  of  the  sine-wave  is  unknown,  we  may  proceed  to 
discard  the  phase  information  by  envelope  predetection  processing  the 
input  waveform  in  an  effort  to  improve  the  information  rate  of  the 
detector.  In  this  case,  using  Eq.  (A-19)  in  Eq.  (3*3-13)*  we  obtain 


K[Sn(M)j 


where  M  is  given  by 
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(3* ^-13) 


(3. *-1*0 


thus 


K(Sn(M)3  =  0.46  (3*^15) 

From  Eq.  (B-43)  and  Eq.  (3.4-15)  we  obtain  the  asymptotic  relative 
efficiency  of  the  median  detector  with  respect  to  the  likelihood  detector 

(M),  l*  =  O'48 

n  n 

Thus,  the  median  detector  is  approximately  half  as  efficient  as  the 
likelihood  detector  for  this  problem- 


58 


3-4.6  fkQMrn-Lm  Detection  of  a  Sine  Wave  in  Marrow-Band  Additive 

Gaussian  Boise 

It  is  seen  from  Eq.  (A-23)  that 
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y  <  0 


(3-4-17) 


Substituting  this  in  Eq.  (3.3-13)  we  obtain  the  statistic  efficacy 

K[S  (M)]  -4M2  e"21*2  (3-4-18) 


where  M  the  median  under  no-signal  conditions  is  given  by 
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J  e'y  dy  (3-4-19) 

0 

thus 

X[S  (M))  -  0.48  (3-4-20) 

n 

Using  Eq.  (3*4-20)  and  Eq.  (B-5l)  we  obtain  the  asymptotic  relative 
efficiency 


00,  K 


0.48 


(3-4-21) 


It  is  the  same  as  that  obtained  by  envelope  predetection  processing  the 
input  waveform. 

3.4.7  Envelope  Detection  of  Narrow-Band  White  Gaussian  Signal  in  Additive 
White  Gaussian  Holse 


Prom  Eq.  (A-33)  we  obtain  that 
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y  <  0 


Substituting  this  in  Eq.  (3-3-13)  we  obtain  the  efficacy  K 
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where  the  medlar.  M  under  no -signal  conditions  is  given  by 
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thus 


K[Sn(M)3  -  0.48 


(3-4-25) 


Using  Eq.  (3-4-25)  and  Eq.  (B-62)  ve  obtain  the  asymptotic  relative 
efficiency 


(M),  I*  ‘ 


(5-4-26) 


Thus,  the  median  detector  is  approximately  half  as  efficient  as  the 
likelihood  detector  for  this  problem. 


3-4.8  Square-Law  Pet,  otion  of  Harrow-Band  White  Gaussian  Signal 
in  Additive  White  Gaussian  Holse 

Using  Eqs.  (A-35),  (A-38)  in  Eq.  (3-3-13)  we  obtain 
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where  the  median  M  is  given  by 

.  JL 

2 

JL  e  **  (3-4-28) 
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aH 

thus 

K[Sn(M)]  -  0.48  (3-4-29) 

Using  Eq.  (3.4-29)  and  Eq.  (B-64)  we  obtain  the  asymptotic  relative 
efficiency 

«®s  (ti).L*-0-48  (5-4-50) 

n  n 

It  is  the  same  as  that  obtained  by  envelope  predetection  processing  the 
input  waveform. 

3-  5  Summary  of  Results 

The  median  detector  was  found  to  possess  many  important  properties. 

It  was  shown  that  the  median  detector  is  distribution-free  in  the  sense 
that  its  false-alarm  rate  is  constant,  independent  of  the  channel  statistics 
as  long  as  the  median  under  no-signal  conditions  is  known.  It  was  also 
seen  that  the  multiplicative  disturbance  does  not  affect  the  distribution- 
free  nature  of  the  median  detector.  Thus,  as  long  as  the  non-station- 
arity  of  the  channel  statistics  is  confined  to  the  statistics  of  the 
multiplicative  disturbance,  the  distribution- free  nature  and  the  structure 
of  the  median  detector  are  not  affected.  However,  the  detection  proba¬ 
bility  of  the  detector  does  depend  on  the  channel  statistics. 

In  the  case  of  the  coherent  detection  of  a  sine  wave  In  additive 


gaussian  noise  and  no  multiplicative  disturbance,  the  information  rate  of 
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Hg.  4.  Probability  of  Error  va.  Received  Mean  SKR  In  the  Detection 
of  a  Sine  Wave  in  Oauaaian  Kolae. 


fig.  7.  Probability  of  Error  vs.  Received  Mean  SNR  in  the  Detection 
of  a  Oausalan  Signal  in  Oauselan  Noise. 


.he  .ned i  an  detector  vu  found  to  be  64$  of  the  information  rate  of  the 
optimum  likelihood  detector.  Or,  in  terms  of  the  input  signal -to-noise 
ratio,  the  optimum  detector  would  require  an  input  signal -to -noi se 
ratio  that  is  80 $  of  that  required  by  the  median  detector  2or  the  same 
probability  of  error  with  the  same  number  of  samples.  Tf  the  input 
waveform  iu  predetection  envelope  or  square-law  processed,  then  the 
information  rate  cf  the  median  detector  is  48$  of  the  information  rate 
of  the  optimum  likelihood  detector.  Or,  in  terms  of  input  signal -to- 
noise  ratio,  the  likelihood  detector  would  require  an  input  signal -to- 
noise  ratio  that  is  70$  of  that  required  by  the  median  detector  for  the 
same  probability  of  error  and  same  number  of  samples . 

A  significant  result  appears  when  the  channel  statistics  include 
additive  disturbance  —  that  is,  an  additive  combination  of  gaussian 
and  impulse  noise.  For  this  case,  the  information  rate  of  the  median 
detector  may  exceed  that  of  the  likelihood  detector  designed  under  the 
gaussian  assumption  and  used  in  this  problem.  In  fact,  if  the  para¬ 
meter  c  of  the  gaussian  and  impulse  noise  distribution  is  equal  to  one, 
the  median  detector  information  rate  is  twice  that  of  the  likelihood 
detector.  Thus,  the  likelihood  detector  *ould  require  twice  as  many 
samples  as  the  median  detector  to  achieve  the  same  error  probability 
for  the  same  input  signal -to-noise  ratio.  Or,  the  median  detector 
now  would  require  a  signal -to-noise  ratio  only  70$  of  that  required 
by  the  likelihood  detector  for  the  same  information  rate  and  proba¬ 
bility  of  error. 

The  results  obtained  in  this  chapter  concerning  the  detec cion  of 
a  sine  wave  in  gaussian  noise  are  plotted  in  Fig.  4  while  those 
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concerning  the  detection  of  a  sire  v-ve  in  gaussitfn  and  impulse  noise 
T.re  shown  in  Fig.  •6.  The  results  pertaining  to  the  detection 
of  a  stochastic  signal  in  noise  axe  plotted  in  Fig.  7*  A  graphical 
comparison  of  the  performances ,  for  various  noise  statistics,  of  the 
median  detector  in  the  detection  of  a  sine  wave  of  known  phase  in 
additive  noise  is  given  in  Fig.  6- 

From  the  results  obtained  in  this  chapter,  it  is  concluded  that 
the  use  of  the  median  detector  entails  only  a  small  loss  in  ef¬ 
ficiency  for  guassian  channel  statistics;  while  in  the  presence  of 
impulse  noise,  the  use  of  the  median  detector  may  lead  to  higher  ef¬ 
ficiency  depending  on  the  distribution  of  the  gaussian  and  impulse 
noise.  In  fact,  the  greater  the  impulse  noise  content,  the  higher 
the  median  detector  efficiency.  Moreover,  the  invariant  structure 
in  the  phase  of  multiplicative  disturbance, whether  stationary  or 
non-stationary,  and  the  disftribution-free  nature  of  the  false -alarm 
rate  of  the  median  detector  add  greatly  to  its  appeal. 


Chapter  4 

LEARNING  MEDIAN  DETECTOR 


4.1  Introduction 

The  median  detector  investigated  in  Chapter  3  tests  for  the 
presence  of  the  signal  by  testing  for  a  change  in  median  under  signal 
and  under  no- signal  conditions.  To  do  so,  it  utilizes  a  data  sample 
which  is  compar'd  with  the  median  under  no-signal  conditions,  the  latter 
assumed  to  be  known.  Rovever,  knowledge  of  the  median  under  no- signal 
conditions  is  not  always  forthcoming  and  the  assumption  of  known  median, 
in  many  practical  cases,  is  not  Justified.  Fbr  example,  the  median  will 
be  unknown  when  the  detector  is  placed  in  an  unknown  environment  and 
immediate  operation  of  the  detector  is  desired.  In  this  situation,  the 
detector  must  learn  the  unknown  median  while  it  is  operating.  The  median 
detector  will  also  have  to  go  through  a  learning  phase  from  time  to  time 
when  the  median  is  varying  rather  slowly  with  time.  It  is  this  learning 
phase  of  operation  of  the  median  detector  that  we  are  concerned  with  in 
this  chapter. 

In  the  present  chapter,  for  stationary  or  at  most  quasi- stationary 
medians,  the  medial  detector  test  statistic  is  modified  so  that  it  learns 
the  unknown  median.  To  do  so,  the  modified  test  statistic  utilizes  an 
estimator  of  the  median.  Conditions  under  which  the  modified  test 
statistic  remains  distribution- free  are  obtained,  and  the  learning  nature 
of  the  detector  baaed  on  the  modified  statistic  is  investigated.  The 
learning  detector  is  then  applied  to  detection  problems  to  which  it  ie. 
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applicable,  and  its  performance  and  learning  efficiency  are  obtained  and 
compared  to  those  of  the  comparable  likelihood  detectors. 

4.2  The  Modified  Test  Statistic 

The  learning  median  detector  is  ba£ed  on  a  test  statistic  that  is  a 
modified  version  of  the  median  detector  test  statistic.  The  modified 
statistic  is 


n 

8n<*>  I  =<*1  '  V 


(4.2-1) 


where  is  an  estimate,  obtained  from  the  reference  waveform  N(t),  of 
the  unknown  median  of  the  additive  disturbance  under  no-signal  conditions 
•Hie  function  c(z)  was  defined  previously.  The  test  statistic  as  defined 
above  is  operating  on  the  input  waveforms  Y(t)  and  N(t)  in  the  same 
manner  as  the  system  shown  in  Fig.  8  . 


Fig.  8.  Block  Diagram  of  L-  aming  Median  Detector 


A 

The  median  estimate  obtained  JVon  N(t)  is  first  subtracted  from 
the  data  sample  function  Y(t),  and  the  resulting  waveform  Z(t)  is  applied 
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to  an  ideal  half-wave  limiter.  Hie  output  of  this  limiter  is  then  sampled 
n  times,  and  the  samples  averaged  to  yield  Sn(M). 

The  test  statistic  Sn(M)  u^ixizes  the  reference  sample  function  to 
estimate  the  unknown  median  under  no- signal  conditions,  the  assumption 
again  being  made  that  the  medians  of  the  reference  and  data  samples  are 
the  same  under  no-signal  conditions.  In  effect,  the  estimates  of  the 
median  serve  as  the  reference  sample  function  for  the  modified  test 
statistic.  Hie  conditions  under  which  the  medians  will  be  the  same  were 
discussed  in  Chapter  3* 

f  - 

t- 

In  utilizing  the  modified  test  statistic,  the  m  reference  samples  [ 

» 

8re  divided  into  n  groups  of  ^  samples  each.  From  each  of  these  n  groups 

an  estimate  of  the  unknown  median  M  is  obtained.  Each  of  these  median  , 

\ 

i 

estimates  is  associated  with  only  one  data  sample.  Thus,  the  median  ! 

A 

estimate  is  associated  with  the  data  sample  .  In  this  manner,  for 

*  *  j 

independent  reference  and  data  samples,  c(Y^  -  M^)  and  c(Yj  -  M^)  are 

independent  random  variables.  Hie  latter  results  in  expressions  for  the 
mean  and  variance  of  Sn(M)  under  no-signal  conditions  that  are 
distribution- free  for  a  wide  class  of  distribution  functions.  Neverthe¬ 
less,  it  must  be  pointed  out  that  the  estimating  procedure  proposed  above 
is  by  no  means  the  most  efficient  one. 

4.2.1  Conditions  for  Distribution- free  Modified  Test  Statistic 

The  modified  test  statistic  false-alarm  rate  will  be  asymptotically 
distribution- free,  provided  the  mean  and  variance  of  the  test  statistic 
are  distribution- free  under  no-signal  conditions.  For  channels  with 
first  order  statistic^  that  are  stationary  or  quasi- stationary  under 
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no-signal  conditions,  the  mean  and  variance  under  no-signal  conditions 
are 
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and 


-  1  -  F  (0) 


,  .  F  (0)  [1  -  F  (0)) 

o  2[S  (M)]  -  — - - - 

o  n'  n 


(4.2-3) 


A 

where  and  Fz(z)  is  the  distribution  function  of  Z  under 

no-signal  conditions.  From  the  above  expressions  for  the  oean  and 
variance,  it  is  seen  that  a  necessary  and  sufficient  condition  for  the 
modified  test  statistic  to  be  distribution- free  is  that  zero  be  a 
specified  quantile  of  the  distribution  of  Z,  regardless  of  the  channel 
statistics.  A  sufficient  condition  for  this  to  be  true  is  given  by  the 
following  theorem. 

Theorem  4.1 

For  channels  with  symmetrical  first  order  statistics  under  no-signal 
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conditions,  the  randan  variable  Z,  ,  i  *  1,  2,  . ..,  n,  has  a  aedian  of 
zero. 

Proof: 

The  random  variable  was  defined  above  as 

\  (4.2-4) 

Urns,  the  probability  density  function  of  Z.  given  by  the  integral 

fz  ^  “  J  fM^  «o(z  +  (4.2-5) 

where  gQ(y)  and  fM(x)  are,  respectively,  the  probability  densities  of  Y^^ 

A 

an-  M.  .  for  i,  mne  -ricul  firs-  order  channel  soatiotico,  g  (y)  and  the 
-  c 

probab  .lit.  density  fQ(x)  >1  X.  are  symmetrical.  It  is  well  kr.own  (30) 
that  for  symmetrical  densities,  the  mean  and  median  coincide.  Thus,  in 
the  case  of  symmetrical  fQ(x),  the  sami  «  «. v  may  be  chosen  as  the 

estimator  of  the  unknown  median.  The  probability  density  function  of  the 
sample  mean  for  large  number  of  samples  is  gausslan  with  mean  equal  to 
the  unknown  median  M;  that  is,  for  reference  and  data  samples  with 
identical  medians  under  no-signal  conditions,  both  fM(x)  and  g  (y)  are 

M  O 

A 

symetrical  about  the  median  M.  Thus,  Yj^  and  M^,  being  symmetrical 
about  the  same  point,  have  equal  means;  and  defined  as  the  difference 
between  the  two,  has  a  mean  of  zero.  To  prove  that  Z has  also  a  zero 
medlar,  it  is  only  necessary  to  prove  that  the  probability  density  of  Z ^ 
is  symmetrical.  The  random  variable  may  be  expressed  as 
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and  tbe  probability  density  of  is  given  by 


’  /  fK<T)  «o(l+Y)  ^ 


(k.Z-j) 


where  the  densities  fM(v)  and  gQ(v'  of  the  randan  variables  Y±  and 
respectively,  are  even  functions.  The  density  f^z)  may  be  written 

(*)  "  ^  fM^vi)  «0(*^)  dy  +  J'  f„(v)  gQ(z-hr)  dv  (4.2-8) 


f  (-z)  ■=  f  fM(r)  «„(-*«)  dr  +  J*  fM(v)  f0(’z'hr)  dy  (4.2-9) 
1  —  0 

=  y  «0(-*“v)  dw  +  y  e0(_*~w)  dw 
0  -  «» 

=  y  f#(v)  B0(z+V)  dw  +  y  fM(w)  gQ(z+v)  dw 


fz  (*) 

zi 


It  is  concluded  fra*  (4.2-9)  that  fj^U)  is  symmetrical  about  zero; 
thus,  it  has  a  median  of  *ero.  This  oaopletes  the  proof. 

The  above  theorem  establishes  tbe  distribution- free  nature  of  the 
modified  test  statistic  for  a  wide  class  of  channels,  namely  the  class 
with  symmetrical  first  order  statistics  under  no-signal  conditions. 

For  symmetrical  first  order  statistics,  the  mean  and  variance  under 


no- signal  conditions  are 


(4.2-10) 
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Eo[Sn(M)]  =  1  -  Fz(0) 


and 
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[Sn(ft)J  = 


Fz(o)[i  -  rt(o)] 

n 


(4.2-11) 


Thus,  the  modified  test  statistic  has  asymptotically  the  same  distribution 
under  no-signal  conditions  as  the  median  detector  test  statistic. 


4.2.2  The  Modified  Test  Statistic  Efficacy 

The  mean  and  variance  of  S  (M)  under  signal  conditions  are 
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Applying  the  mean  value  theorem  (23)  to  G  (y),  ve  obtain  in  the  weak 

ei 

signal  case 
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or,  since  G0(y)  =  FQ(y),  we  have 
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Substituting  this  in  Eqs.  (4.2-12)  and  (4.2-13)  we  obtain 
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where  0  and  0£  were  defined  in  Chapter  Z,  respectively,  r  th  -y;er..  end 
mean- square  value  of  the  signal-to-noise  ratio  0. 

Utilizing  Eqs.  (4.2-11)  and  (4.2-16),  we  obtain  the  efficacy  of  Sfi(M) 
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It  will  be  shown  in  the  next  section  that  all  of  the  performance 
indices  of  the  detector  utilizing  the  modified  test  statistic  are 
completely  specified  by  the  modified  test  statistic  efficacy.  Thus,  the 
learning  nature  of  the  detector  may  be  examined  by  investigating  the 
convergence  properties  of  the  efficacy.  In  the  limit  of  large  number  of 
estimating  samples,  the  density  f^(x)  of  the  median  estimator  tends  to 
an  inpulse  function 
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In  the  same  Halt,  the  efficacy  becomes 
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(4.2-20) 


=  K(M) 

It  is  seen  from  Eq.  (4.2-20)  that  the  performance  of  the  detector  based 
on  the  modified  statistic  improves  as  the  number  of  estimating  samples 
increases  snd,  in  the  limit,  the  modified  median  detector  is  as 
efficient  as  the  median  detector.  Thus,  the  modified  detector  consti¬ 
tutes  a  learning  system  (13)  with  respect  to  an  unknown,  stationary  or 
quasi-stationary  median  —  hence,  the  name  "learning  median  detector" 
for  the  modified  detector. 


4.2.3  Performance  Indices 

The  modified  test  statistic  is  equal  to  a  jum  of  independent 
binomially  distributed  random  variables;  hence  it  follows  from  the 
central  limit  theorem  (22)  that  8n(M)  is  asymptotically  gaussian  under 
signal  and  u^ler  no-signal  conditions.  The  modified  statistic  then 
satisfies  condition  (A).  Condition  (D)  is  fulfilled  in  the  weak  signal 
case  investigated  here.  In  the  weak  signal  case,  the  existence  of  the 
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efficacy  is  the  only  requirement  for  the  statistic  to  satisfy  conditions 

(B),  (C)  and  (E).  The  efficacy,  given  by  Eq.  (4.2-18),  vill  exist  if 
dG  (x) 

— — —  exists  —  that  is,  if  the  median  detector  efficacy  exists. 

d0  6  *  0 

The  latter  exists  for  continuous  parameter,  continuous  density  functions 

g_(x).  It  is  seen  from  Eq.  (4.2-11)  that  3  (M)  satisfies  condition  (F) 

&  n 

always.  The  conditions  (E)  and  (F)  establish  the  consistency  of  Sn(ft). 
Since  the  modified  statistic  satisfies  all  of  conditions  (A)-(F), 


its  performance  relation  and  output  signal- to- noise  ratio  are  given  h'r 


rdV*;  i 
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FM(x)  O  n  «  2  erf  (l-2a)  +  erf  ^(l-20)  (4.2-21) 


(4.2-22) 


The  efficacy  may  also  be  used,  as  shown  in  Chapter  2,  to  obtain  the 
asymptotic  relative  efficiency  of  3^(6)  with  respect  to  a  likelihood 
s.ati  cic.  Thus,  the  efficac;  K(ft)  completely  specifies  all  of  the 
performance  indices  of  the  learning  median  detector  for  symmetrical 
first  order  channel  statistics. 

m  j  .jpi  cations 

In  the  following,  the  learning  median  detector  is  applied  to  detec¬ 
tion  problems  with  symmetrical  first  order  distributions  for  which  it 
remains  distribution- free. 

4.3.1  Detection  of  a  Sine  Wave  in  Additive  Noise 
for  this  general  problem  we  have 
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d  G0(y) 
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and  using  this  in  Eq.  (4.2-18)  we  obtain 
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(4.3-2) 


4.3.2  Detection  of  &  Sine  Wave  in  Additive  Gaussian  Boise 

©is  is  a  specific  case  of  the  previous  detection  problem  where 
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Thus,  the  efficacy  is 
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Using  Eqs.  (3.4-6)  and  (4.3-4)  we  obtain  the  asymptotic  relative  effi 
ciency  of  the  learning  median  detector  with  respect  to  the  median 
detector.  The  ARE  is 


ABE3n(M),Sn(M) 


(4.3-5) 
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The  asymptotic  relative  efficiency  of  the  learning  median  detector  with 
respect  to  the  learning  optimum  livelihood  detector  is  obtained  using 
Eqs.  (4.3-4)  and  (B-l8).  It  is  given  by 


A  A  2 

(M),L*(M)  *  7 
n'  o'  ’ 


(*•3-6) 


The  above  result  indicates  that  the  learning  median  and  likelihood 
detectors,  both  utilizing  the  sample  mean  as  an  estimator  of  the  unknown 
median,  are  equally  efficient  in  their  learning  the  median,  in  the  case 
of  gaussian  statistics. 


4.3.3  Detection  of  a  81  ne  Wave  in  Additive  Combination  of  Gaussian  and 
Impulse  Noise 

This  is  also  a  specific  case  of  the  general  problem  discussed  in 
Section  4.3.1.  Jbr  the  present  problem  f  (x)  is 
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The  efficacy  of  the  learning  median  detector  for  large  number  of 
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estimating  samples  —  is  given  by 
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Using  Eqs.  (3.4-8)  and  (4.3-8)  we  obtain  the  asymptotic  relative  efficiency 
of  the  learning  median  detector  with  respect  to  the  median  detector  for 
known  median.  The  ABE  is  given  by 

«\(M),Sn(lO  -  '  2  "  I  1  -  erf  (\f1  )T 


The  asymptotic  relative  efficiency  of  the  learning  median  detector,  with 
respect  to  the  learning  likelihood  detector  designed  under  the  gaussian 
assumption,  is  obtained  utilizing  Bqs.  (4.3-8)  and  Bq.  (B-l8).  The  ARE 
is 


(4.3-10) 


The  above  expression  for  ARE  indicates  that  the  learning  median  detector 
and  learning  likelihood  detector,  both  utilizing  the  sample  mean  as  an 
estimator  of  the  unknown  median,  are  not  equally  efficient  in  learning 
the  median  of  a  combination  of  gaussian  and  impulse  noise.  Specifically, 
it  is  seen  that  the  learning  likelihood  detector  is  more  efficient  in 
learning  the  unknown  median  than  the  learning  median  detector. 

4.4  Summary  of  Results 

In  this  chapter,  the  statistic  on  which  the  median  detector  is 
based  was  modified  so  that  it  learns  tne  unknown  median.  The  detector 
based  on  the  modified  statistic  was  shown  to  be  a  learning  system  with 
respect  to  the  unknown  median,  since  its  performance  improves  and 
converges  to  the  performance  of  the  median  detector  with  known  median, 
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Fig.  10.  Efficacy  ▼».  Number  of  Ea  tinting  Seuaplea  in  the  Coherent 
Detection  of  a  Bine  Wave  in  Impulse  and  Oausslan  Noise. 
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Detection  of  a  Sine  Wave  in  Impulse  and  Gaussian  Noise. 
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as  the  learning  time  Increase.  The  learning  median  detector  was  also 
shown  to  be  distribution- free  for  a  vide  class  of  detection  problems  — 
namely,  the  class  with  symmetrical  first  order  distributions. 

'Hie  learning  median  detector  was  applied  to  the  detection  of  a 
sine  wave  of  known  phase  in  gaussian  noise  and  also  in  a  combination  of 
gaussian  and  impulse  noise.  In  the  gaussian  case,  the  learning  median 
detector  and  the  learning  optimum  likelihood  detector  are  equally 
efficient  in  learning  the  unknown  median.  Bie  efficacy  of  the  learning 
median  detector  converges  rapidly  with  increasing  number  of  estimating 
samples  to  the  efficacy  of  the  median  detector  with  known  median. 

Ifrese  results  are  presented  in  Fig.  9.  When  impulse  noise  is  present 
in  the  channel  the  learning  median  detector  is  not  as  efficient  as  the 
learning  likelihood  detector  in  learning  the  unknown  median.  In  this 
case  the  learning  median  detector  efficacy  does  not  converge  to  the 
median  detector  efficacy  as  rapidly  as  in  the  detection  problem  with 
gaussian  noise  only.  However,  in  the  presence  of  impulse  noise,  the 
information  efficiency  of  the  learning  median  detector  is  greater  than 
that  of  the  learning  likelihood  detector  even  for  a  moderate  number  of 
estimating  samples.  These  results  are  presented  In  Fig.  10.  A  graphical 
presentation  of  the  functional  relation  between  the  learning  median 
detector  probability  of  error  and  input  signal- to- noise  ratio  is  given 
in  Fig.  11  for  the  case  of  gaussian  channel  statistics  and  in  Fig.  12 
for  a  combination  of  impulse  and  gaussian  channel  statistics. 

From  the  results  obtained  in  this  chapter,  it  is  concluded  that  use 
of  the  learning  median  detector  instead  of  the  learning  likelihood 
detector  entails  only  a  small  loss  of  detection  efficiency  for  gaussian 
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channel  statistics;  while  if  impulse  noise  is  present  in  the  channel, 
use  of  the  learning  median  detector  results  in  higher  detection  efficiency. 
Moreover,  the  learning  median  detector  is  distribution- free  for  symmetrical 
first  order  distributions,  hence  applicable  even  when  the  form  of  the 
distributions  is  unknown. 
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Chapter  5 

ADAPTIVE  MEDIAN  DETECTOR 


5-1  Introduction 

The  distribution-free  coincidence  detection  procedures  investigated 
in  the  previous  chapters  test  for  the  presence  of  the  signal  by  testing 
for  a  change  in  median  under  signal  and  under  no-signal  conditions.  In 
particular,  the  median  detector  is  applicable  to  the  detection  problem 
when  the  median  under  no-signal  conditions  is  stationary  or  at  most  quasi - 
stationary,  and  it  requires  that  the  value  of  the  median  under  no-signai 
conditions  b3  known  in  order  that  its  false-alarm  rate  remain  distribution- 
free.  The  learning  median  detector  does  not  require  knowledge  of  the 
median,  instead  it  utilizes  an  estimate  of  the  unknown  median  for  station¬ 
ary  or  at  most  quasi -stationary  medians.  However,  the  learning  median 
detector  remains  distribution -free  only  for  the  class  of  detection  problems 
with  symmetrical  first  order  statistics  under  no-signal  conditions.  Thus, 
use  of  the  learning  median  detector  instead  of  the  median  detector  is, 
in  effect,  equivalent  to  replacing  the  restriction  of  known  medians  by 
the  restriction  of  symmetrical  first  order  channel  statistics.  To  summa¬ 
rize,  the  median  and  learning  median  detectors  remain  distribution-free 
only  when  a)  the  median  under  no-signal  conditions  is  stationary  or  at 
most  quasi -stationary  and  b)  when  the  median  is  known  or  when  the  first 
order  channel  statistics  are  symmetrical  under  no-signal  conditions. 
However,  there  exist  detection  problems  in  which  the  location  parameters, 
in  particular  the  median,  are  non -stationary  and,  moreover,  their  time- 
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/ariations  are  unknown-  In  addition,  not  all  detection  problems  have 
symmetrical  first  order  statistics.  Hence,  the  need  exists  for  a  dis¬ 
tribution-free  detection  procedure  applicable  ever  when  the  noise  medians 
are  unknown  and  non-stationary  and  one  that  remains  distribution- free 
for  a  wider  class  of  detection  problems. 

In  the  present  chapter,  a  modified  version  of  the  median  detector 
that  is  adaptive  to  rapid  changes  in  the  median  under  no-signal  conditions 
is  proposed  and  investigated.  The  conditions  under  which  the  adaptive 
median  detector  remains  distribution-free  are  obtained.  It  is  found  that 
the  adaptive  median  detector  remains  distribution-free  for  a  much  wider 
class  of  detection  problems  than  the  median  detector  or  the  learning 
median  detector.  The  adaptive  median  detector  is  then  applied  to  various 
detection  problems  of  interest,  and  its  performance  is  obtained  and 
coo$)ared  to  that  of  the  other  distribution -free  detectors  and  to  that 
of  comparable  likelihood  detectors • 

5«2  The  Modified  Test  Statistic 

The  adaptive  median  detector  is  based  on  a  modified  version  of  the 
median  detector  test  statistic .  The  modified  test  statistic  is 


n 


i=l 


where  y^  and  x^,  i  =  1,  2,  ...,  n,  are  the  values  of  the  data  and 
reference  samples  obtained,  respectively,  from  Y(t)  and  N(t).  The  test 
statistic  as  defined  above  is  operating  on  the  input  waveforms  Y(t)  and 


Fig.  13.  Block  Diagram  of  Adaptive  Median  Detector 
The  reference  a  ample  function  N(t)  is  first  subtracted  from  the  data 
sanple  function  Y(t),  and  the  resulting  waveform  Z(t)  is  then  applied 
to  an  ideal  half-wave  limiter.  The  output  of  the  limiter  is  then 
sampled  and  the  samples  averaged  to  yield  Sq. 

Application  of  the  adaptive  median  detector  requires,  as  did  the 
median  detectors  discussed  previously,  that  the  members  of  each  sample 
pair  (Yi,  )  have  identical  medians.  This  will  be  true,  for  instance, 
if  the  additive  disturbances  in  the  reference  and  data  channels  have 
identical  first  order  statistics.  However,  for  non- stationary  channel 
statistics,  the  first  order  statistics,  and  hence  the  median,  may  vary 
from  sample  pair  to  sample  pair. 

5*2.1  Conditions  for  Distribution-free  Modified  Test  Statistic 

The  modified  test  statistic  false-alarm  rate  will  be  asymptotically 
distribution-free,  provided  the  mean  and  variance  of  the  test  statistic 
are  distribute  on-free  under  no-signal  conditions.  The  mean  and  variance 
under  no -signal  -mditions  are 
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where  Z.  =  Y  -  X. ,  and  F  is  the  distribution  of  Z  under  no-signal 

111  4*^  1 

conditions.  From  the  above  expressions  for  the  mean  and  variance,  it  is 
noted  that  a  necessary  and  sufficient  condition  for  the  modified  test 
statistic  to  be  distribution-free  is  that  zero  be  a  specified  quantile  of 
the  distribution  of  Z^,  i  ■  1,  2,  n,  regardless  of  the  channel 

statistics.  In  particular,  if  zero  is  the  median  of  Z^,  then  the  distri- 

A 

bution  of  S  is  the  same  as  the  distribution  of  S  (M)  and  S  (M),  under 

a  n  n 

no-signal  conditions.  A  sufficient  condition  for  to  have  a  zero  median 
is  given  by  the  following  theorem 

Theorem  5°1 

For  detection  problems  with  reference  and  data  channels  possessing 
symmetrical  first  order  statistics  under  no-signal  conditions,  the  random 
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variable  Z^,  i  «*  1,  2,  . ..,  n,  has  zero  median. 

Proof: 

The  proof  is  the  same  as  tiiat  of  Theorem  4.1,  where  one  substitutes 
tQ  (x),  the  distribution  of  i  *  1,  2,  ...,  n,  under  no-signal  conditions, 
in  place  of  f^Cx)  • 

The  above  theorem  establishes  the  distribution-free  nature  of  the 
adaptive  median  detector  false-alarm  rate  for  the  class  of  detection 
problems  with  symmetrical  first-order  statistics  and  otherwise  arbitrary 
statistics.  In  particular,  the  distribution  of  may  differ  from  that 
of  A  wider,  and  perhaps  a  more  practical,  class  of  detection  problems 
for  which  the  adaptive  median  detector  remains  distribution-free  is  given 
by  the  following  theorem. 

Theorem  5.2 

For  detection  problems  with  reference  and  data  channels  possessing 
identical  first  order  statistics  under  no-signal  conditions,  the  random 
variable  Z^,  1  *  1,  2,  ...,  n,  has  zero  medipn. 

Proof: 

Under  the  conditions  of  the  theorem,  f  (x)  -  g  (x),  thus  the  value 

'  o, 

at  zero  of  the  distribution  of  Z ^  is 

F„  (o)  «  P{Z  >  0) 

Zi  1 

-  P(Yi  >  Xi) 

CO  00 

d  F  (x)  d  0  (y) 

°i  °i 


(5.2-4) 


TO 


-  f  [1  -  T  (x)j  d  r  (x) 

y.  °i  °i 

1 

m  — 

2 

This  completes  the  proof. 

It  is  seen  that  theorem  5-2  establishes  the  distribution-free 
nature  of  the  adaptive  median  detector  test  statistic  for  the  class  of 
detection  problems  with  identical  reference  and  data  channel  first 
order  statistics. 

Thus ,  it  is  seen  from  the  above  theorems  that  regardless  of  whether 
the  channel  statistics  are  stationary  or  non-stationary,  as  long  as  the 
first  order  statistics  of  the  reference  and  data  channels  are  either 
symmetrical  or  identical  under  no-signal  conditions,  the  adaptive 
median  detector  false -alarm  rate  is  distribution- free .  The  mean  and 
variance  under  no-signal  conditions  are 

n 

W-5  I  U-Mo)]  (5.2-5) 

i-1  1 

1 

m  •— 

2 


n 


^1 


5-2.2  The  Modified  Test  Statistic  Efficacy 

The  efficacy  of  the  modified  statistic  will  be  obtained  for  the 
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class  of  detection  problems  with  first  order  stationary  statistics, 
under  no-signal  conditions.  Under  signal  conditions,  it  will  be 
assumed  that  the  distribution  of  differs  from  the  distribution  of 
i  ^  i>  only  through  the  signal -to-noiae  ratio.  This  assumption 
is  satisfied  in  many  detection  problems  of  interest. 

For  this  class  of  detection  problems,  the  mean  and  variance  under 
signal  conditions  are 
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°e2's„l  *  K  i  V  [c(Yi  -  V1  (5-2-8) 

n  r~i  i 
i*l 

n 

*  ^2  I  p(eiHi  -  p(»i)] 

i-l 


Proceeding  as  in  Chapter  we  obtain,  for  the  weak  signal  case  and 
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data  and  reference  channels  with  identical  first  order  statistics  under 
no-signal  conditions,  that  the  mean  and  variance  under  signal  conditions 
are 


E  [S  3 
9  nJ 


-  B  [S  3  -  0 
o  nJ 


d  GQ(x) 
~d0 


d  jro(x) 


(5-2-9) 


and 

“  2 

d  F  (x)  (5-2-10) 

^0 

where  0  and  G*-  are,  respectively,  the  mean  and  mean-square  values  of  the 
signal-to-noise  ratio. 

Utilizing  Eqs.  (5-2-6)  and  (5-2-9),  we  obtain  the  efficacy  of  S 

n 


ae2  'V 


o  2[s  ]  -  i  e2 

o  n  n 


/ 


d  G0(x) 


de 


K  =  4 


r 

4  »,w 

y 

de 

9=0 


d  Fo(x) 


(5-2-11) 


It  is  shown  in  the  following  section  that  the  performance  indices 
are  completely  specified  by  the  efficacy.  Thus,  the  adaptive  nature  of  the 
detector  may  be  established  by  observing  the  behavior  of  the  efficacy 
with  increasing  number  of  reference  samples  and  fixed  number  of  data 
samples  -  It  is  seen,  from  Eq.  (5. 2-11),  that  the  efficacy  remains  fixed 
under  the  above  conditions;  therefore,  the  detector  is  indeed  adaptive 
with  respect  to  an  unknown  median  (13)  —  hence,  the  name  "adaptive 
detector"  for  the  modified  detector. 


5-2-3  Performance  Indices 

By  applying  the  central  limit  theorem  to  Sn,  it  is  seen  that  the 
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test  statistic  satisfies  condition  (A).  Condition  (D)  is  fulfilled 
in  the  weak  signal  case  investigated  here.  Eq.  (5-2-6)  reveals  that 
S  satisfies  condition  (F) .  In  the  weak  signal  case  and  under  the  con- 


n 


ditions  for  which  the  efficacy  given  by  Eq.  (5-2-11)  was  derived,  the 


existence  of  the  efficacy  insures  that  the  test  statistic  satisfies 

d  G0(x) 

conditions  (B),  (C)  and  (E).  The  efficacy  will  exist  if 


d6 


0*0 


exists  —  that  is,  if  the  median  detector  efficacy  exists-  This 
can  be  shown  as  follows-  If  the  median  detector  efficacy  exists,  then 
exists,  hence 


d  G0(x) 


d0 


0-0 


d  G0(x) 

de 


<  A 


^0 


(5-2-12) 


where  A  is  a  finite  number.  Thus, 


J  d  °e(x) 


d0 


-klf  A  d  'o« 
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d  Fo(x) 
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(5-2-13) 


<  A" 


and  the  adaptive  median  detector  efficacy  exists  also- 

Since  the  modified  statistic  satisfies  all  of  conditions  (A)-(F), 
its  performance  relation  and  output  signal-to-noise  ratio  for  the  weak 
signal  case  and  data  and  reference  channels  with  identical,  stationary 
first  order  statistics,  under  no-signal  conditions,  are  given  by 
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fln  =  a  erf"  (l-2a)  +  erf  (l-20) 

(5-2-14) 


and 
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i  Oe(x) 
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9=0 


d  Fq(x) 


/  C  C 
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-15) 


The  efficacy  may  also  be  used,  as  shown  in  Chapter  2,  to  obtain  the 
asymptotic  relative  effi, 'ency  of  with  respect  to  other  detectors. 
Thus,  the  efficacy  K  completely  specifies  all  of  the  performance  indices 
of  the  adaptive  median  detector  for  the  conditions  for  which  the  efficacy 
given  in  Eq.  ( 5 .2-11 )  is  applicable. 


5-5  Applications 

In  the  following,  the  median  detector  is  applied  to  specific  detection 
problems;  its  performance  in  the  problems  is  evaluated  and  compared  to 
that  of  other  distributicn-free  detectors  and  to  that  of  comparable  likeli¬ 
hood  detectors. 


5-3-1  Detection  of  a  Sine  Wave  of  Known  Phase  in  Additive  Noise -General 
Case 

For  this  general  detection  problem  we  have 


d  G0(x) 
' "  dQ 


9=0 


fo(x) 


(5-3-1) 


and  using  this  in  Eq.  (5.2-11)  we  obtain 
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K  «  k 


f  (x)  dx 
o 


(5-3-2) 


The  efficacy  of  the  likelihood  detector,  appropriate  to  the  problem,  is 
i;cn  oy  Eq-  (B-33)  as 

K*  -  |  (5.3-3) 


Thus,  the  asymptotic  relative  efficiency  of  the  adaptive  median  detector 
with  respect  to  the  comparable  likelihood  detector  is 


"*8  ,1* 


f  2(x)  dx 
o  ' 


(5.3-^) 


Pitman  (29)  has  shown  that  the  lowest  possible  value  of  the  above 
integral  squaied  is  equal  to  9/125*  Thus,  for  this  general,  problem, 
the  lower  bound  of  the  adaptive  median  detector  efficacy  is 

K  .  =  0.288  (5.3-5) 

min  • 


and  the  lower  bound  of  the  asymptotic  relative  efficiency  is 

ares  1*  *  0.576  (5.3-6) 

n*  n 

The  asymptotic  relative  efficiency  may  be  anything  from  the  minimum 
gi/en  above  to  infinity,  depending  on  f_(x). 

5.3.2  Detection  of  a  Sine  Wave  of  Known  Phase  in  Additive  Gaussian  Noise 
This  problem  is  a  specific  case  of  the  previous  general  detection 
problem  ,  with  fQ(x)  given  by  Eq.  (A-4).  Utilizing  Eq.  (A-U)  in  Eq. 
(5.3-2),  we  obtain 


78 


l 

rr 


(50-7) 


Using  Eqs.  (50-7)  and  (50-3)  we  obtain  the  asymptotic  relative  efficiency 
of  the  adaptive  median  detector  with  respect  to  the  adaptive  optimum 
likelihood  detector.  The  ARE  is 


n 


2 

IT 


(50-8) 


The  asymptotic  relative  efficiency  of  the  adaptive  median  detector  with 
respect  to  the  median  detector  is  obtained  using  Eqs.  (50-7)  and  (3*4-6). 
It  is  given  by 


ARE 


S  ,S  VM) 
n  nv  ' 


1 

2 


(50-9) 


The  asymptotic  relative  efficiency  of  the  adaptive  median  detector  with 
respect  to  the  Earning  median  detector  is  derived  using  Eqs.  (50-7) 
and  (4-3-4).  The  ARE  is 

,B  ob  •  5  C1  +  liO  <5-5-10> 

n  nv 

It  is  seen  from  Eq.  (5.2-24)  that  use  of  the  adaptive  median  detector 
instead  of  the  median  detector  results  in  reduction  of  the  infcrmation 
rate  by  one-half.  Use  of  the  adaptive  median  detector  instead  of  the 
learning  median  detector  entails  a  loss  in  information  rate  even  for 
a  small  number  of  estimating  samples,  such  as  two  or  three.  For  esti¬ 
mating  sample  sizes  greater  than  ten,  the  information  rate  is  almost 


helved . 
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5- 3-3  Detection  of  a  Sine  Wave  of  Known  Riasc  In  Additive  Gaussian 
and  Impulse  Noise 

This  problem  also  is  a  specific  case  of  the  general  problem.  Thus, 
using  Eq.  (A -6)  in  Eqs.  (5-3-2)  and  (5-3-4),  we  obtain  for  c  ■  1 


(5-3-11) 


and 


"h  ,i*  * 1 


(5-3-12) 


The  asymptotic  relative  efficiencies  of  the  adaptive  median  detector 
with  respect  to  the  median  and  learning  median  detectors  are  obtained 
utilizing  Eq.  (5-3-H)  end  Zqs.  (3-4-8)  and  (4.J8),  respectively.  The 
ARE's,  for  c  «  1,  are 

,S  (M)  -  X  l5-J-15) 

n  nx 


and 


ARE 


S  ,S  (M) 
n  n 


(5-3-1^) 


An  examination  of  the  above  symptotic  relative  efficiencies  reveals  that 
in  the  case  of  gaussian  and  impulse  noise,  the  adaptive  median  detector 
is  as  efficient  as  the  comparable  likelihood  detector.  However,  the 
adaptive  median  detector  information  rate  is  only  1/4  that  of  the  median 
detector.  Even  for  small  estimating  sample  sizes,  the  information  rate 
of  the  adaptive  median  detector  is  smaller  than  that  of  the  learning  median 
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detector . 

5-3 Detection  of  a  Sine  Wave  of  Unknown  Phage  in  Additive  Gaussian 

Boise 


Using  Eq.  (A-lU)  in  Eq.  (5-2-11),  we  obtain 


I  f  3  °9W 

d  F  (x) 

- J  de 

0 

9=0 

-i  2 


(5-3-15) 


J  x  02  (0,  a)  dx 


The  coaments  made  in  Chapter  3  regarding  this  problem  are  applicable 
here  also- 


5-3-5  Envelope  Detection  of  a  Sine  Wave  in  Narrow-Band  Gaussian  Noise 
Using  Eq.  (A-19)  in  Eq.  (5.2-11),  we  obtain 
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dx 


(5-3-16) 


-  0-25 

Using  £qs.  (5-3-16)  and  (3-^-15)>  we  obtain  the  asymptotic  relative 
efficiency  of  the  adaptive  median  detector  with  respect  to  the  median 
detector.  The  ARE  is 


ARE 


S.,S  (M)  ■  °-52 


(5-3-17) 


n'  n 


The  asymptotic  relative  efficiency  of  the  adaptive  median  detector  with 
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respect  to  the  comparable  likelihood  detector  is  obtained  using  Eqs. 
(5-3-16)  and  (B-48).  The  ARE  is 

AREg  L*  =  1  (5-3-18) 

n'  n 


5-3-6  Square -Lav  Detection  of  a  Sine  Wave  in  ffarrow-Band  Additive 
Gaussian  Boise 

Using  Eq.  (A-25)  in  Eq.  (5-2-11),  ve  obtain 


«  0-25 


(5-3-19) 


and  the  asymptotic  relative  efficiencies  are  as  in  the  previous  problem. 


5.4  Summary  of  Results 

In  this  chapter,  a  modified  version  of  the  median  detector  that 
is  adaptive  to  an  unknown  stationary  or  non- stationary  median  was  pro¬ 
posed  and  investigated.  The  conditions  under  which  the  adaptive  median 
detector  remains  distribution-free  were  also  obtained.  It  was  shown 
that  the  adaptive  median  detector  remains  distribution- free  for  two 
wide  classes  of  detection  problems •  Specifically,  the  adaptive  median 
detector  false-alarm  rate  remains  distribution-free  for  all  detection 
problems  with  symmetrical  first-order  statistics  under  no-signal 
conditions-  It  also  remains  distribution- free  for  all  detection  problems 
with  identical  first-order  reference  and  data  channel  statistics,  under 
no-signal  conditions. 

The  adaptive  median  detector  was  applied  to  the  detection  of  a  sine 
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wave  in  additive  noise,  and  its  performance  in  the  problem  investigated. 
The  results  of  this  investigation  ar  -  presented  in  Table  1. 

Table  1 

Performance  of  Adaptive  Median  Detector  in  Detecting 
a  Sine  Wave  in  Additive  Noise 


Sine  Wave  of  Known  Phase 

3ine  Wave  of  Unknown  Phase 
Gaussian  Noise 

Lower 

Bound 

c  =  2 

c  *  1 

Predetection 

Processing 

No  Predetection 
Processing 

K 

0.288 

O.3I8 

0.500 

0.250 

0 

"Vl 

n'  n 

0.576 

0.637 

1.000 

1.000 

0 

,8  (M) 
n'  n' 

0.500 

0.250 

0.520 

***3  ,3  (M) 
n’  n' 

m 

An  examination  of  the  above  table  reveals  that  the  adaptive  median 
detector  is  highly  efficient  for  the  detection  of  a  sine-wave  in 
additive  noise  of  unknown  median.  Specifically,  the  adaptive  median 
letf'ctor  information  rate  is  never  less  than  '7*6$  of  the  information 
riwc  f  the  :onp&r£bie  IfKflihSod  UTtector.  the  "if  c_ne 

;avc  i  f  known  phase  and  guassian  noise,  the  adaptive  median  detector 
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information  rate  is  63.7$  of  that  of  the  optimum  likelihood  detector. 
Hovever,  when  the  noise  is  a  combination  of  impulse  and  g&ussian  noise, 
the  adaptive  median  detector  information  rate  is  equal  to  the  information 
rate  of  the  comparable  likelihood  detector.  For  the  detection  problem 
of  a  sine  wave  of  unknown  phase  in  guassian  noise  and  with  predetection 
processing  of  the  input  waveform,  the  adaptive  median  detector  information 
rate  is  equal  to  that  of  the  adaptive  "optimum'*  likelihood  detector. 

It  is  also  seen  from  Table  1  that  the  adaptive  median  detector  is 
less  efficient  than  either  the  median  detector  or  the  learning  median 
detector.  This,  however,  is  expected  since  the  median  detector  requires 
and  uses  knowledge  about  the  channel  statistics,  namely  the  value  of  the 
median  of  the  additive  noise,  that  the  adaptive  median  detector  does 
not  require  and  does  not  use.  The  learning  median  detector,  although 
it  does  not  require  this  additional  knowledge  of  the  channel  statistics, 
does  require  and  utilize  more  reference  samples  than  the  adaptive  median 
detector . 

In  Figs,  Ik  and  15,  the  probability  of  error  of  the  adaptive  median 
detector  is  plotted  vs.  the  input  signal-to-noise  ratio  for  all  the 
detection  problems  investigated  in  this  chapter. 

From  the  results  obtained  in  this  chapter,  it  is  concluded  that  use 
of  the  adaptive  median  detector  instead  of  an  adaptive  likelihood  detector 
entails  either  a  small  loss  of  detection  efficiency  or  none  at  all. 
Moreover,  the  adaptive  median  detector  is  distribution- free  for  wide 
classes  of  detection  problems,  hence  applicable  even  when  the  form  of  the 


distributions  is  unknown. 
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Chapter  6 
THE  T-DETECTOR 


6-1  Introduction 

In  this  chapter,  a  distribution-free  detector  of  stochastic 
signals  in  noise  is  proposed  and  investigated.  This  is  based  on 
a  test  statistic  that  tests  for  the  presence  of  the  signal  by- 
testing  for  a  difference  in  variance  between  the  reference  and 
data  samples.  The  test  statistic  is  the  so-called  T-statistic— 
hence  the  name  "T-detector"  for  the  distribution- free  detector 
that  utilizes  it.  In  the  following,  the  general  properties  of  the 
T-statistic  are  given  and  its  efficacy,  output  signal-to-noise 
ratio,  and  performance  relation  are  obtained.  Subsequently,  the 
T-detector  is  applied  to  the  detection  of  a  gaussian  signal  in 
gaussian  noise,  and  its  performance  is  evaluated  and  conpared 
to  that  of  the  optimum  detector. 


6.2  The  T  statistic 

The  T-w.et--ctor  is  based  on  the  T-statistic  first  proposed 

by  Sukhatme  (51 )  and  defined  as 
n  m 

Vi  i  1  t(yl'X3) 

i=l  j«=l 


where 

♦  (y^  Xj)  ■  1»  if 


=  0,  otherwise 


0  <  <  yi 


yi  <  XJ  <  ° 


f 


(6.2-1) 
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Application  of  the  T-statistic  to  the  detection  problem  is  based 
on  the  assumption  that  the  variances  of  the  reference  and  data  s'tatples 
are  the  same  under  no-signal  conditions •  This  will  be  true,  for  instance, 
if  the  additive  disturbances  in  the  reference  and  data  channels  have 
identical  first  order  statistics  under  no-signal  conditions.  In  this 
investigation,  the  above  condition  on  the  first  order  statistics  will 
be  assumed.  Moreover,  the  reference  and  data  channel  first  order 
statistics  will  be  assumed  stationary  or  at  most  quasi-stationary.  Thus, 
the  random  variables  1*1,  2,  . ..,  n  will  have  identical  first 
order  distribution  functions,  as  will  the  random  variables  X^,  j  *1,2,..., 
m. 


6.2.1  Conditions  for  Distribution-free  Test  Statistic 

The  T-statistic  is  a  modified  version  of  the  Wile oxon -Mann -Whitney 

(31)  statistic.  Mann  and  Whitney  proved  (4)  the  asymptotic  nrcmality 

of  the  Wilcoxon  statistic  under  no-signal  conditions  and  Lehman  proved 

it  (4)  under  signal  conditions.  Utilizing  these  results,  it  can  be 

shown  that  the  T-statistic  is  asymptotically  normally  distributed  under 

signal  and  under  no-signal  conditions.  Thus,  the  T-statistic  false- 

alarm  rate  will  be  asymptotically  distribution-free  if  its  mean  and 

*  • 

variance  are  distribution- free  under  no-signal  conditions*  The  mean 
and  variance  under  no-signal  conditions  are  (31) 
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where  Fq(x)  is  the  distribution  of  the  reference  and  data  samples 
under  no-signal  conditions.  From  the  above  expressions,  it  is  seen 
that  a  necessary  and  sufficient  condition  for  the  T-statistic  false- 
alarm  rate  to  be  distribution-free  is  that  zero  be  a  specified 
quantile  of  the  distribution  Fq(x),  regardless  of  the  channel 
statistics.  Thus,  the  T-statistic  false-alarm  rate  will  be  distri¬ 
bution-free  for  the  class  of  distribution  functions  F  (x)  with  zero 
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median.  For  t..Oi>e  cistribution  functions  w-i:.  ntn-zero  medians,  the 
medians  may  be  subtracted  out  free  the  incoming  reference  and  data  sample 
functions  so  that  samples  obtained  from  the  modified  sample  functions 
have  zero  median.  In  the  latter  case,  the  T-statistic  becomes 


T 

mn 


(M,N) 


n  m 


i-1  j-1 


♦ 


*«) 


(6.2-4) 


where 

y'i  *  y±  -  M  (6.2-5) 

*j  -  xj  -  * 

and  M  and  N  are  the  medians  of  the  data  and  reference  samples  under 

»  • 

no-signal  conditions.  Thus,  i  -  1,  2,  ...,  n  and  Y^,  J  -  1,  2,  ...,  m 
have  zero  medians. 

To  summarize,  the  T-statistic  false-alara  rate  will  be  distribution- 
free  a)  for  the  class  of  detection  problems  with  zero  medians  and  b)  for 
the  class  of  detection  problems  with  non-zero  medians  provided  these 
medians  sure  known.  With  regard  to  the  latter  class  of  detection  problems, 
it  must  be  pointed  out  that  there  exists  a  subclass  that  does  not  require 
knowledge  of  the  medians  under  no-signal  conditions.  This  is  the  class 
of  detection  problems  with  symmetrical  first-order  statistics  under  no¬ 
signal  conditions.  The  mean  and  median  for  this  class  of  problems 
coincide.  Thus,  the  value  of  the  non-zero  medians  is  not  required 
since  the  medians  can  be  made  zero  by  subjecting  the  reference  and  data 
channel  sample  functions  to  capacitive  filtering  prior  to  their 
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examination  by  the  T-detector. 

For  the  case  of  input  reference  and  data  waveforms  with  zero 
medians,  the  mean  and  variance  of  the  T-statistic  under  no-signal 
conditions,  obtained  from  Eqs.  (6.2-2)  and  (6.2-3),  are 

WM'B»  ■  5  <6-2-6> 


and 


n(M,N)] 
o  mn 


m+n+7 
46  mn 


(6.2-7) 
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for  m  >  >  n  >  >  7 


6.2.2  The  T-Statistic  Efficacy 

For  stationary  or  quasi -stationary  first-order  statistics  under 
signal  and  under  no-signal  conditions  and  for  identical  reference  and 
data  channel  first-order  statistics  under  no-signal  conditions,  the 
T-statistic  mean  and  variance  under  signal  conditions  are  (31) 
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Applying  the  mean  value  theorem  (23)  to  G0(y),  we  obtain  for  the  weak 


signal  case 
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(6.2-10) 


or,  since  G  (y)  *  F  (y),  we  have 
o  o 
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Substituting  this  in  Eq.  (6.2-8)  we  obtain 
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Using  Eqs.  (6.2-7)  and  (6.2-12),  we  obtain  the  efficacy  of  the 
T-statistic  for  m  >  >  n.  This  is 
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(6.2-13) 


6.2-3  Performance  Indices 


As  stated  previously,  the  T-statistic  is  asymptotically  normally 
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distributed  under  signal  and  under  no-signal  conditions ;  hence,  it 

satisfies  condition  (A) .  Condition  (Q)  is  fulfilled  in  the  weak  signal 

case  investigated  here.  Eq.'  (6.^-7)  reveals  that  T  (M,N)  satisfied 

mn 

condition  (F).  in  the  weak  signal  case  and  under  the  conditions  for 
which  the  efficacy  given  by  Eq.  (6.2-13)  was  derived,  the  existence 
of  the  efficacy  insures  that  the  test  statistic  satisfies  conditions 


(B),  (C)  and  (E).  The  efficacy ‘tfill  exist  if 


d09(x) 

ae 


exists . 


The  latter  becomes  apparent  frcm  an  examination  of  Eq.  (612-13) • 


If 


de 


exists,  then  the  test  statistic  satisfies  all  of 


0= ) 


conditions  (A)-(F)  ;n  the  weak^signal  case.  Hence,  for  data  and 
reference  channels'  with  first-order  statistics  identical  under  no- 
signal  conditions  and  stationary  or  quasi -stationary  both  under  signal 
and  under  no-signal  conditions,  the  T-statistic  performance  relation 
and  output  signs 1-to-noi^e  ratio  are  given  by 
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(6.2-15) 


The.  efficacy  may  also  be  used  to  obtain  the  asymptotic  relative 

efficiency  of  T  (M,N)  with  respect  to  other  statistics.  Thus,  the 
mn 

efficacy  specifies  all  of  the  performance  indices  of  the  T-detector 
for  the  conditions  under  which  the  efficacy  given  in  Eq.  (6.2-13) 
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is  applicable. 


6.3  Applications 

In  the  following,  the  T-detector  is  applied  to  the  detection  of  a 
gaussian  signal  in  gauss ian  noise;  its  performance  is  evaluated  and 
compared  to  the  performance  in  the  same  problem  of  the  optimum  likeli¬ 
hood  detector.  Results  concerning  the  asymptotic  relative  efficiency 
of  the  T-detector  with  respect  to  a  particular  likelihood  detector,  in 
the  general  problem  of  scalar  alternatives,  are  also  given. 


6.3*1  Detection  of  Narrow-Band  White  Gaussian  Signal  in  Additive  White 
Gaussian  Hoise 

Using  Eqs.  (A-25)  and  (A-28)  in  Eq.  (6.2-13)  we  obtain  the  T- 
statistic  efficacy.  This  is 


K(M,N) 


(6.3-1) 


.  3 

n2 

Using  Eqs.  (6.3.1)  and  (B-59)  we  obtain  the  asymptotic  relative  efficiency 
of  the  T-detector  with  respect  to  the  optimum  likelihood  detector.  The 
ARE  is 


(M,N),  L*  '  °‘61  <6->2> 

mn'  ’  n 

6*3*2  T-statistic  Performance  in  the  General  Problem  of  Scalar 
Alternatives 

The  problem  of  scalar  alternatives  is  one  with  distributions  Fq(x) 
and  Uq(x),  under  the  hypothesis  and  under  the  alternative,  respectively, 
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related  as  follows 


Ge(x)  -  Fo(0  x) 


(6-3-?) 


Sukhatme  (31)  has  obtained  in  general  the  asymptotic  relative  efficiency 
of  the  T-statistic  with  respect  to  the  variance-ratio  F-test,  a  likelihood 
statistic  optimum  for  gaussian  statistics.  The  asymptotic  relative 
efficiency  for  the  problem  of  scalar  alternatives  is  given  by  (31) 


ARET  (M,N),  F  =  12 
mn 
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where 
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It  can  be  seen  from  Eq.  (6.3-4)  that  the  asymptotic  relative  efficiency 

can  be  anything  from  zero  to  infinity,  depending  on  fQ(x).  In  particular 

if  f  (x)  =  4  e”^  the  APE  is  equal  to  0*94. 
o  d 

6.4  Summary  of  Results 

In  this  chapter,  the  T-detector  for  the  detection  of  stochastic 
signals  in  noise  was  proposed  and  investigated.  It  was  shown  that  the 
T-detector  false-alarm  rate  can  be  made  distribution-free  given  the 
medians  of  the  reference  and  data  samples  under  no-signal  conditions. 

Even  in  the  absence  of  this  minimal  information  concerning  the  statistics 
of  the  detection  problem,  the  T-detector  false-alarm  rate  was  shown  to 
be  distribution-free  for  two  classes  of  detection  problems,  a)  the  class 
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of  detection  problems  with  zero  medians  under  no-signal  conditions, 
and  b)  the  class  of  detection  problems  with  symnetrical  first-order 
statistics  under  no-signal  conditions. 

The  T-detector  was  applied  to  the  detection  of  a  gaussian  signal 
in  gaussian  noise,  and  its  performance  in  the  problem  investigated.  It 
was  found  that  the  T-detector  is  reasonably  efficient  for  gaussian 
statistics  and  highly  efficient  for  seme  non-gauasian  statistics. 
Specifically,  the  T-detector  information  rate  for  the  case  of  a 
gaussian  signal  in  gaussian  noise  was  shown  to  be  6l£  of  that  of  the 
optimum  likelihood  detector.  The  results  for  this  problem  are  presented 
graphically  in  Fig.  16* 

From  the  results  obtained  here,  it  is  concluded  that  use  of  the 
T-detector  instead  of  a  likelihood  detector  entails  only  a  small  loss 
of  detection  efficiency  for  gaussian  channel  statistics;  while  for  non- 
gaussian  statistics,  an  increase  in  efficiency  is  possible,  depending 
on  f  (x) .  Moreover,  the  T-detector  is  distribution-free  for  wide 
classes  of  detection  problems,  hence  applicable  even  when  the  form  of 


the  distributions  is  unknown. 
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Chapter  7 

ADAPTIVE  T -DETECTOR 


7-1  Introduction 

The  T-detector  investigated  in  the  previous  chapter  can  be  made 
distribution-free  provided  the  medians  of  the  reference  and  data 
samples  under  no-signal  conditions  are  known.  The  T-detector  remains 
distribution-free  even  when  the  medians  are  unknown  but  only  for  two 
limited  classes  of  detection  problems,  namely,  the  class  of  detection 
problems  with  zero  medians  and  the  cl  suss  of  problems  with  symmetrical 
first-order  reference  and  data  channel  statistics  under  no-signal 
conditions.  However,  the  above  classes  do  not  include  many  of  the 
problems  of  practical  importance.  There  exist  problems  in  which  the 
location  parameters  of  the  distributions,  in  particular  the  medians, 
are  non- stationary  with  unknown  time  variations.  In  suldition,  not 
in  all  detection  problems  are  the  first  order  statistics  symmetrical 
or  the  medians  zero.  Hence,  the  need  exists  for  a  distribution- 
free  detection  procedure  which  is  applicable  even  when  the  noise 
medians  are  changing  and/or  unknown  and  one  that  remains  distribution' 
free  for  a  wider  class  of  detection  problems. 

In  this  chapter,  a  modified  version  of  the  T-detector  that  is 
adaptive  to  rapid  changes  in  the  medians  and/or  to  unknown  medians 
is  proposed  and  investigated.  The  conditions  under  which  the 
adaptive  1-detectcr  remains  distribution-free  are  obtained.  It  is 
found  that  the  adaptive  T-detector  remains  distribution-free  for  a 
much  wider  class  of  detection  problems  than  the  T-detector.  The 
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adaptive  T-detector  is  then  applied  to  the  detection  of  a  gaussian  signal 
in  gaussian  noise,  and  its  performance  is  evaluated  and  ccaxpared  to  the 
performances  of  the  T-detector  and  of  the  optimum  likelihood,  detector. 

7*2  The  Modified  Test  Statistic 

The  adaptive  T-detector  is  based  on  a  modified  version  of  the 
T-statistic.  The  modified  T-statistic  is 

n/2  r'8 

Tmn  *  mn  X  X  ^  ^21  "  y2i-]l  ^X2J  "  x2j-l^  (T-2-1) 

i-1  j-1 

n/2  V2 

«  X  X  *(Ti'V 

i-1  j-1 

where  v±  «  y2i“y21-l'  uj  “  x2j“  x2j-l>  ^  V  k  “  1,2 f "  '*  n'  1111(1  xl* 
i  «  1,2, . . .,  m,  are  the  values  of  the  data  and  reference  samples  ob¬ 
tained,  respectively,  from  Y(t)  and  N(t).  The  function  f(v,u)  was 
defined  previously.  The  test  statistic  as  defined  above  is  operating 
on  the  sample  functions  Y(t)  and  N(t)  in  the  same  manner  as  the  system 
shown  in  Figure  17*  Here  ^x^  and  ^Xg  are,  respectively,  the  rates 
at  which  Y(t)  and  N(t)  are  sampled- 

Application  of  the  adaptive  T-detector  to  the  detection  of 
stochastic  signals  in  noise  requires,  as  did  the  T-detector,  that  the 
variances  of  the  reference  and  data  samples  are  identical  under  no¬ 
signal  conditions.  The  latter  will  be  true,  for  instance,  if  the 
additive  disturbances  in  the  reference  and  data  channels  have  first 
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order  statistics  of  identical  form  and  differing,  if  at  all,  only  in 
their  location  parameters- 


Fig.  17-  Block  Diagram  of  Adaptive  T-detector 

7-2.1  Conditions  for  Distribution-free  Modified  Test  Statistic 

The  conditions  under  which  the  modified  T-statistic  is  distri¬ 
bution-free  are  given  by  the  following  theorem. 

Theorem  7-1 

The  modified  I-statistic  false  alarm  rate  remains  asyaptotically 
distribution-free  for  the  class  of  detection  problems  with  reference 
and  data  channel  first-order  statistics  having  the  following  properties 


w  m 
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under  no-signal  conditions: 

a)  the  first-order  statistics  are  stationary  or  quasi-stationary 
in  form  with  at  most  non-stat? onary  location  parameters; 

b)  the  reference  and  data  channel  first-order  statistics  are 
of  identical  form,  differing,  if  at  all,  only  in  their 
location  parameters; 

c)  the  members  of  each  sample  pair  (Y2i,  ^i-l^  i  ■  1,  2, 
n/2  ,  have  identical  first.-order  statistics; 

d)  the  members  of  each  sample  pair  (X,y,  X2J-1^  J  “  1>  2, 
m/2  ,  have  identical  first-order  statistics 

Proof- 

Because  of  condition  (a)  we  have  that 

F  (y-Mj  -  F  (y),  all  k  -  1,  2,  n  (7*2-2) 

yk  °y 

and 

F  (x  -  Nj  -  F  (x)  ,  all  X  -  1,  2,  m  (7*2-?) 

xj e  x  °x 

where  and  are,  respectively,  the  medians  of  the  random  variables 
Y^  and  X^.  Moreover,  because  of  condition  (b)  we  have  that 

*  (y-^)  -  rx  Fo(x)  ^  k  -  1,  a,  n  (7-2-*0 

k  1  l  ■=  1,  2,  m 

Conditions  (c)  and  (d)  in  conjunction  with  Eq.  (7* 2-1*)  simply  state, 
respectively,  that 

F  (y-M. )  -  F  (y-M. )  ■  F  (y)  ,  all  i  *  1,  2,  ••*,  n/2 
y2i-l  1  y2i 

(7-2-5) 


and 
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Fv  (>:  -  N  )  *  F  (x  -  N.)  »  F  (x)  ,  all  j  «  1,  2,  ...,  m/2 
2j-l  J  jo 

(7-2-6) 


Using  Eq.  (7-2-5)  ,  we  obtain  the  probability  density  of  where 
Vi  =  y2i  -  Y2i-1'  This  is 


\M  -  I 


t  (y)  f  (y  +  v)  dy 
y2i  y2i-l 


f  (x  -  M. )  f  (x  +  v-M. )  dx 
1  *21-1  1 


00 


f  (x)  f  (x  +  v)  dx 
o  o 

-  00 


(7-2-7) 


Thus,  the  density  functions  of  the  random  variables  ,  i  *  1,  2,  . .., 

n/2  are  the  same  and  given  by  Eq.  (7-2-7)  above-  In  the  same  manner 

and  using  Eq.  (7*2-6),  it  is  easily  shown  that  the  random  variables 

Uy  j  =  1,  2,  ...,  m/2  have  the  same  density,  given  by  Eq.  (7-2-7) 

also.  Thus,  it  has  been  established  that  the  random  variables  V.^ 

i  *  1,  2,  ...,  n/2  and  U  ,  j  *  1,  2,  ...,  m/2  ,  have  identical  distri- 

J 

butions.  Hence,  according  to  reference  (31),  the  mean  and  variance 
of  the  modified  test  statistic  are  given  by  Eqs.  (6.2-2)  and  (6.2-3) 
where  Fq(o)  must,  in  this  case,  be  substituted  by  Fy(0)  where  F^(v) 
is  the  common  distribution  of  and  under  no-signal  conditions. 
Also,  in  this  case,  m  and  n  must  be  substituted  in  Eqs.  (6.2-2)  and 
(6.2-3)  by  n/2  and  m/2,  respectively.  From  these  expressions  for 
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the  mean  and  variance,  it  is  sei.i  t»  at  &  necessary  una  sufficient 
condition  for  me  modified  test  etc'  istic  l'-  lse -alarm  rate  to  be 
any  pt otic ally  distribution-free  is  that  zero  be  a  .vpccifieu  quantile 
of  the  distribution  Fv(v),  regs^dlc ■  r.  of  the  channel  statistics -  This 
can  be  shown  to  be  true  usings  iiq*  (7*2-7) •  Thus 


fy(v)  dv 

m 

f  f  (x)  f  (x  +  v)  dxdv 
J  0  0 


(7*2-8) 


OP 


f0w 


f  (x  +  v)  dv 


dx 


Fo(x)  dFo(x) 


1 

2 


q.e >d* 


This  completes  the  proof  of  the  theorem. 

It  is  seen  from  the  above  theorem  that  regardless  of  the  form  of 
the  channel  statistics  and  regardless  of  whether  the  noise  medians 
axe  rapidly  varying  and/or  unknown,  the  modified  T-statistic  remains 
distribution-free  for  the  class  of  detection  problems  with  reference 
and  data  channel  first-order  statistics  of  identical  and  stationary 
form,  under  no-nignal  conditions*  for  this  class  of  detection  problems, 
the  mean  i  nd  variance  under  no-sij:nal  conditions  are 
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(7-2-9) 


for  m  >  >  n  >  >  7 


(7-2-10) 


7-2.2  The  Modified  T-statistic  Efficacy 

For  the  class  of  detection  problems  given  by  Theorem  7*1>  the 
modified  T-statistic  mean  under  signal  conditions  is 
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(7-2-11) 


where  G  (x)  and  F  (x)  are  the  distributions  of  the  random  variable 
V  under  signal  and  under  no-signal  conditions,  respectively.  Proceeding 
in  the  same  manner  as  in  Chapter  6,  we  obtain  the  efficacy  of  the 
modified  T-statistic  for  m  >  >  n  >  >  7-  This  is 
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(7-2-12) 

7*2. 3  Performance  Indices 

It  was  shown  in  the  previous  chapter  that  the  T-statistic  satisfies 
all  of  the  conditions  (A)  -  (F)  in  the  weak  signal  case.  The  modified 
T-statistic,  if  expressed  in  terms  of  v^  and  Uy  is  equivalent  to  the 
T-statistic;  hence,  it  too  satisfies  all  of  conditions  (A)  -  (F)  in  the 

CGVU) 


weak  signal  case  and  whenever 


d0 


exists.  Thus,  in  the  weak 


0=0 


signal  case  and  for  the  class  of  detection  problems  specified  by  theorem 
7-1,  the  modified  T-statistic  performance  relation  and  output  signal-to- 


noise  ratio  are  given  by 
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The  efficacy  given  in  Eq.  (7-2-12)  may  also  be  used  to  obtain  the 

asynqitotic  relative  efficiency  of  T  with  respect  to  other  statistics. 

mn 

Thus,  the  efficacy  specifies  all  the  performance  indices  of  the  adaptive 
T-detector  for  the  conditions  under  which  the  efficacy  given  in  Eq. 

(7- 2.-12)  is  valid. 


7-3  Applications 

In  the  following,  the  adaptive  T-detector  is  applied  to  the  detection 
of  a  gausslan  signal  in  gauasion  noise;  its  performance  in  the  problem 
is  evaluated  and  compared  to  the  performance  in  the  same  problem  of  the 
T-detector  and  of  the  optimum  likelihood  detector. 

7-3-1  Detection  of  Harrow-Band  White  Gaussian  Signal  in  Additive 
White  Gaussian  Noise 

The  probability  density  functions  gLy(x)  and  f^(x)  are,  in  this 

case,  _  ven  by 

2 

x 

f  (x)  =  e"  2,2  ,  -  «  <  X  <  *  (7-3-1) 

v  2tt2 
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Thus, 


dG  (x) 
v 

de 


e-o 


X 

2 


f  (x) 

V 


(7.3-3) 


The  adaptive  detector  efficacy  is  obtained  using  Eqs. 
in  Eq.  (7<2-12).  The  efficacy  is 


(7-3-1)  and  (7.3-3) 
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(7.3^) 
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TT 

Using  Eqs.  (6.3-1)  and  (7*3-M  we  obtain  the  asynqjtotic  relative 
efficiency  of  the  adaptive  T-detector  with  respect  to  the  T-detector. 
The  ARE  is 


AREt 

'  inn. 


1 

T  (M,N)  “  2 
mn  w  ' 


(7-3-5) 


The  asymptotic  relative  efficiency  of  the  adaptive  T-detector  with 
respect  to  the  optimum  likelihood  detector  is  obtained  using  Eqs. 

(B-59)  and  (7.3-^)-  The  ARE  is 

ARE  L*  =  0.305  (7.3-6) 

"Sun,  n 

The  results  for  this  problem  are  presented  graphically  in  Fig.  18  ■ 


7*k  Summary  of  Results 

In  this  chapter,  a  modified  version  of  the  T-detector  that  is 
adaptive  to  rapid  changes  in  the  location  parameters  —  specifically 
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the  Bedlams  and/or  to  unknown  medians  -  vas  proposed  and  investigated. 

The  conditions  under  which  the  adaptive  T-detector  remains  distribution- 
free  were  also  obtained.  It  was  shown  that  the  adaptive  T- detector 
false  alarm  rate  remains  asymptotically  distribution-free  for  the  class 
of  detection  problems  with  reference  and  data  channel  first-order 
statistics  that  are  of  identical  and  stationary  form,  under  no- signal 
conditions . 

The  adaptive  T-detector  was  applied  to  the  detection  of  a  gausslan 
signal  in  gausslan  noise,  and  its  performance  investigated.  It  was 
found  that  the  adaptive  T-detector  is  half  as  efficient  as  the  T-detector. 
This,  however,  is  expected  since  the  adaptive  detector  utilizes  for 
detection  only  half  as  many  samples  as  the  T-detector;  the  other  half 
is  used  to  make  the  adaptive  detector  distribution- free  for  a  wide 
class  of  problems  even  when  the  medians  are  rapidly  varying  and/or  unknown. 
The  adaptive  T-detector  Information  rate  was  found  to  be  30jt  of  that  of 
the  optimum  likelihood  detector. 

From  the  results  obtained  in  this  chapter,  it  is  concluded  that 
use  of  the  adaptive  T-detector  instead  of  a  likelihood  detector  entails 
a  loss  of  detection  efficiency  for  gausslan  channel  statistics. 

However,  the  adaptive  T-decsctor  is  applicable  even  when  the  form  of  the 
distributions  is  unknown,  since  it  remains  distribution- free  for  a  wide 
class  of  detection  problems. 
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Chapter  8 
CONCLUSION 

8.1  Sunaary  of  Problem  Discussion  and  Pra^rtti r#w 

We  have  been  concerned  In  this  vork  with  a  class  of  two-input  detection 
systems  for  digital  communication  over  random  and  unknown  channels.  The 
two-input  systems  herein  investigated  possess  false -alarm  rates  that  are 
invariant  for  wide  classes  of  channel  statistics.  The  motivation  for 
considering  such  systems  arises  from  the  need  of  insuring  an  acceptable 
performance  in  a  changing  and/or  incompletely  known  environment. 

Specifically,  in  this  work,  coincidence  detection  procedures  with 
Invariant  or  distribution- free  false-alarm  rates  were  proposed  and  inves¬ 
tigated.  In  the  distribution-free  coincidence  procedures  investigated,  the 
threshold  was  chosen  to  be  a  specified  noise  distribution  quantile  (i.e.,  the 
median)  so  that  the  test  statistic  possessed,  asymptotically  and  under  no¬ 
signal  conditions,  a  known  distribution.  Independent  of  the  statistics  of 
the  detection  problem. 

The  coincidence  detection  procedures  were  subsequently  modified  so 
that  the  detectors  based  on  them  constituted  learning  systems  with  respect 
to  slowly  varying  and/or  known  location  parameters.  The  coincidence  pro¬ 
cedures  were  modified  in  still  another  manner  so  that  the  detectors 
utilizing  these  modified  procedures  constituted  adaptive  systems  with 
respect  to  rapidly  varying  and/or  unknown  location  parameters. 

The  distribution-free  coincidence  detectors  were  applied  to  various 
detection  problems  of  practical  importance;  their  performances  were 
evaluated  and  compared  to  the  performance  of  comparable  likelihood 
detectors . 

In  addition  to  the  distribution-free  coincidence  detectors,  a 
detector  well  suited  for  the  detection  of  stochastic  signals  in  noise  was 
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proposed  and  investigated.  The  T-statistic  ws  subsequently  modified  so 
that  the  detector  utilizing  the  modified  statistic  constituted  an  adaptive 
system  with  respect  to  rapidly  varying  and/or  unknown  location  parameters. 
After  obtaining  the  wide  classes  of  detection  problems  for  which,  the  T- 
detector  and  the  adaptive  T-detector  false-alarm  rates  remained  distribu¬ 
tion-free,  the  detectors  were  then  applied  to  detection  problems  of 
practical  importance;  their  performances  were  evaluated  and  compared  to 
that  of  the  optimum  likelihood  detector. 

8.2  Conclusions 

The  invariant  nature  of  the  test  statistic  distribution  under  no¬ 
signal  conditions  insured  a  false-alarm  invariant  with  respect  to  changes 
in  the  channel  statistics.  The  median  of  the  noise  under  no- signal 
conditions  was  the  only  information  concerning  the  channel  statistics 
that  was  required  by  the  distribution- free  coincidence  procedures , 

Also  obtained  were  the  classes  of  detection  problems  for  which  the 
false-alarm  rates  of  the  above  coincidence  procedures  remained  distribution- 
free. 

It  was  found  that  distribution- free  coincidence  detectors  were  quite 
efficient,  though  sub-optimal,  for  channels  with  gausslan  statistics,  and 
highly  efficient  for  channels  having  a  combination  of  gaussian  and  impulse 
noise. 

The  T-detector  and  the  adaptive  T-detector  were  found  to  be  reasonably 
efficient  for  the  detection  of  gaussian  signals  in  gaussian  noise  and 
highly  efficient  for  some  non-gaussian  channel  statistics. 

In  general,  from  the  results  obtained  in  this  investigation,  it  is 
concluded  that  use  of  the  distribution- free  detectors  proposed  here, 
instead  of  equivalent  likelihood  detectors,  entails  only  a  small  loss  of 


no 


detection  efficiency  for  gausslen  channel  statistics;  while  in  the  case  of 
impulse  and  gaussian  noise  present  in  the  channel,  use  of  1  he  distribution- 
free  detectors  results  in  higher  detection  efficiency.  Moreover,  the 
distribution- free  detectors  have  invariant  false-alarm  rates  for  wide 
classes  of  channel  statistics  -  hence,  they  are  applicable  even  when  the 
form  of  the  probability  distributions  is  unknown.  In  addition,  the 
detectors  proposed  herein  have  invariant  and  simple  structures  and  can, 
therefore,  be  easily  implemented. 

8.3  Recommendation  for  Further  Study 

The  distribution- free  detectors  proposed  in  this  investigation  merit 
further  consideration.  In  particular,  the  performance  of  these  detectors 
for  large  signal-to-noise  ratios  needs  to  be  investigated.  It  would  also 
be  of  interest  to  investigate  their  performance  and  distribution- free 
nature  for  the  case  of  dependent  samples.  The  above  studies  are  in 
general  difficult  to  do  theoretically;  hence,  a  computer  simulation  study 
and/or  experimental  Investigation  could  be  substituted. 

The  distribution- free  coincidence  detection  procedures  investigated 
utilized  the  median  under  no-signal  conditions  as  their  threshold  level. 
However,  other  distribution  quantiles  could  also  be  used.  An  investigation 
of  the  properties  and  evaluation  of  the  performance,  in  detection  problems 
of  practical  importance,  of  coincidence  detection  procedures  utilizing 
as  threshold  levels  Quantiles  other  t.hrn  the  median,  would  constitute 
an  important  extension  of  the  present  work. 

Finally  it  would  be  of  interest  to  investigate  the  distribution- 
free  nature  and  detection  efficiency  of  a  generalized  coincidence  detec¬ 
tion  procedure  employing  as  test  statistic  a  weighted  sum  of  coincidence 
type  test  statistics  having  various  distribution  quantiles  as  their 
respective  threshold  levels.  In  connection  with  the  generalized  coinci¬ 
dence  procedures,  it  would  be  of  importance  to  obtain  a  weighting 
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procedure  that  minimizes  the  variance  of  th?  generalized  coincidence 
test  statistic  or  better  yet  to  obtain  a  weighting  procedure  that 
maximizes  the  infoznation  rate. 
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Appendix  A 

DETECTION  PROBLEMS  INVESTIGATED 

A-l  Detection  of  a  Constant  in  Additive  Noise  -  General  Case 

In  this  problem,  the  signal  is  either  one  of  constant  amplitude 
or  a  sine  wave  of  known  phase  sampled  always  at  the  same  point,  preferably 
at  its  peak,  so  that  as  far  as  the  samples  are  concerned,  this  is  equiva¬ 
lent  to  a  signal  of  constant  amplitude.  The  sijgial-to-noise  ratio  9  is 
defined  as 


9 


(A-l) 


where  a  is  the  noise  variance  and  A  is  the  amplitude  of  the  constant 
signal  in  the  case  of  a  constant  signed,  or  the  peak  amplitude  of  the 
sine  wave  in  the  case  of  a  sinusoidal  signal  -. 

The  probability  distribution  function  FQ(y)  under  no -signal  conditions 
and  the  probability  distribution  G  (y)  under  signal  conditions  are 
related  as  follows 


G0(y)  “  FQ(y  -  9) 


(A-2) 


hence  (4) 
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where  fQ(y)  is  the  probability  density  function  under  no-signal  conditions 


A-2  Detection  of  a  Constant  in  Additive  Gaussian  Noise 


This  detection  problem  is  a  specific  case  of  the  previous  general 


(A-*0 


(A-5) 


A- 3  Detection  of  a  Constant  In  Additive  Comblna+ion  of  Gaussian  and 


This  detection  problem  is  also  a  specific  case  of  the  general 
problem  treated  in  section  (A-l),  with  probability  density  under  no¬ 
signal  conditions  fQ(y)  given  by 


fD(y) 


<  y  <  ® 


(A-6) 


This  form  of  noise  was  chosen  because  it  realistically  represents 
(ll,  24)  the  ampli*  Me  statistics  of  a  noise  source  consisting  of  an 
additive  cambiaition  of  gaussian  and  impulse  noise.  The  relationship 
between  the  parameters  a,  b,  and  c  can  be  derived  from  the  following 
eouations 

00 

J  *0Ky)  <3y  a  1 

-  00 

00 

J  /  f0(y)  dy  -  i 

-  00 

the  latter  equation  simply  ensuring  a  noise  variance  of  one.  The 
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relation  of  interest  is 


2 
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r  (?/0 

r3  (  X/c) 


For  this  problem 
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A- 4  Detection  of  a  Sine  Wave  of  Unknown  Phase  in  Additive  Gaussian  Noise 
The  distribution  function  under  signal  conditions  for  this  detection 
problem  has  been  shown  to  be  (25) 
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where  the  mean  of  the  noise  is  assumed  to  be  zero,  a  is  the  mean  square 
value  of  the  noise,  A  is  the  maximum  amplitude  of  the  sine  wave  and  8 
is  defined  as 

a2 

8  =  — — p  (A-10) 

2o 

that  is,  8  is  the  ratio  of  the  mean  square  value  of  the  signal  to  the 
mean  square  value  of  the  noise-  The  functions  0(y)  and  $  (y)  are 


defined  as 
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$  (y)  *  J  0  00  dx  ,  -  00  <  y  < 
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The  distribution  F  (y)  under  no-signal  conditions  is  found  from  Eq. 

o 

(A-9)  by  setting  9*0 
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Differentiating  Eq.  (A-9)  gives 


dG0(y) 

lie 


y2 

'2? 


/2 


-  ®  <  y  < 


(A-ll!) 


n  a 


A- 5  Envelope  Detection  of  a  Sine  Wave  in  Narrow-Band  Gaussian  Noise 
In  this  detection  problem,  the  observed  waveform  is  the  envelope 
of  a  sine  wave  and  additive  narrow-band  noise.  The  frequency  of  the 
sine  wave  is  the  same  as  the  center  fiequency  of  the  noise  baud.  The 
noise  is  assumed  to  be  a  gaussian  random  process  with  zero  mean.  Under 
these  conditions,  the  distribution  functions  under  signal  and  under  no¬ 
signal  conditions  are  (26) 
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where  y  is  the  amplitude  of  the  envelope,  o  is  the  mean  square  value 
of  the  noise,  Iq(x)  Is  the  modified  Bessel  function  of  the  first  kind, 
zero-th  order,  and  the  signal -to-noise  ratio  9  is  equal  to  the  sign&l- 
to-noise  power  ratio;  namely 


where  A  is  the  peak  amplitude  of  the 
The  distribution  function  under 


sine  wave. 

no-signal  conditions  is 
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From  Eq.  (A-15)  we  obtain  the  distribution  f>inction  under  signal 
conditions,  which  in  turn  gives  (4) 


dG0(y) 

“di 


fr-0 


y  >  0 


(A-19) 


■  0  ,  y  <  0 

A-6  Square -Law  Detection  of  a  Sine  Wave  in  Narrow-Band  Gaussian  Noise 
In  this  detection  problem  the  signal  is  again  a  sine  wave  immersed 
in  additive  narrow-band  noise.  The  frequency  of  the  sine  wave  is  the 
same  as  the  center  frequency  of  the  noise  band.  The  noise  is  assumed 
to  be  a  gaussian  randan  process  with  mean  zero  and  mean  square  value  one. 
The  observed  waveform  is  the  output  of  a  square-law  detector.  The 
probability  densities  of  the  output  of  the  square-law  detector  under 
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signal  and  under  no-signal  conditions  are 


gQ(y)  *  e  "(y  +  0)  I'J.Z'ffy)  ,  y  > 


(A- 20) 


-  0  , 


y  <  0 


f  (y)  *=  e"y 


y  >  0 


(A-21) 


y  <  0 


where  Iq(x)  is  the  modified  Bessel  function  defined  previously,  and  the 
signal-to-noise  ratio  0  is  equal  to  the  signal-to-noise  p^wer  ratio; 


namely 


(A-22) 


where  A  is  the  peak  amplitude  of  the  sine  wave,  and  o'*  is  the  mean 
square  value  of  the  noise  in  this  case  equal  to  one.  Fran  Eq  (A-20) 
we  obtain 


dG0(y) 


y  e  "y  , 


y  >  0 


(A-23) 


y  <  0 


A- 7  Detection  of  Narrow-Band  White  Gaussian  Signal  in  Additive  Narrow- 
Band  White  Gaussian  Noise 

In  this  problem,  the  observed  waveform  is  a  sample  function  from 
a  random  process  which  is  the  sum  of  a  narrow-band  white  gaussian  signal 
process  and  a  narrow-band  white  gaussian  noise  process.  The  processes 
are  centered  at  the  same  frequency  and  have  zero  means.  The  probability 
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densities  of  the  detector  ?nput  under  signal  and  under  no-signal 


conditions,  respective".  ,  are 


g  (y)  - - 

0  o„  ^2rr(l  +  8) 


20JJ  (1+6) 


<  y  < 


(A-2U) 


N 


f0(y) 


_  zL 

i  2a/ 

- e  , 


°N  /2n 


_  OD  <  y  <  00  (A-25 ) 


where  a„  is  the  mean  square  value  of  the  noise,  and  the  signal-to- 
N 

noise  ratio  0  is  equal  to  the  signal-to-noise  power  ratio 

2 


e 


's 


(A-26) 


N 


where  o-T  is  the  mean  square  vlaue  of  the  signal* 
s 

The  distribution  function  of  the  detector  input  under  signal 
conditions,  obtained  from  Eq.  (A-24),  is  given  by 


>(y)  •  / 


Vl+< 


•  CD 


aN  >T2tt 


2 

_  JL_ 
2oN2dy 


(A-27) 


0N/i+e  j 


Differentiating,  we  obtain 


dGe(y) 

To 


9=0 


■  -  I  f0« 


(A-28) 
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A— 8  Envelope  Detection  of  Narrow-Band  White  Gaussian  Signal  in 

Additive  Harrow-Band  White  Gaussian  Noise 

In  this  problem,  the  signal  is  again  a  narrow-band  white  gaussian 
random  process  immersed  in  an  additive  narrow-band  white  gaussian  noise 
process.  The  signal  and  noise  random  processes  are  assumed  to  be 
centered  at  the  same  frequency  and  to  have  zero  means.  However,  in 
this  problem,  the  input  waveform  prior  to  its  examination  by  the 
detector  is  passed  through  a  linear  envelope  detector.  Thus,  the 
observed  waveform  is  the  envelope  of  a  sample  function  from  a  randan 
process  that  is  the  sum  of  two  narrow-band  white  gaussian  processes. 

The  probability  densities  of  the  envelope  under  signal  and  under  no¬ 
signal  conditions  are  (27) 


ge(y) 


20/(1  +  e) 

—  I -  e  *  ,  y  >  0 

oN  2(i  +  e  ) 


(A-291 


y  <  0 


f  (y)  *  e 

o  d 


,  y  >  0 


(A-30) 


y  <  0 


wnere  cs  and  oN  are,  respectively,  the  signal  and  noise  mean  square 
values.  The  signal-to-noise  ratio  9  is  equal  \o  the  signal-to-noise 
power  ratio 


(A-31) 


1 2, 


The  distribution  function  G  (y)  under  signal  conditions  is 

V 


;e(y)  -/ 


>Ti+e 


v 

at: 


2oN  dy 


(A-32) 


-  F  (  ) 


y  l  +  e 


Differentiating,  we  obtair 


dG0(y) 

"de 


fr=0 


-  |  f0(y) 


(a-33) 


A-9  g/pi«yp-T^»y  Detection  of  Marrow-Band  White  Gaussian  Signal  in 
Additive  Narrow-Band  White  Gaussian  Hoise 

In  this  detection  problem,  as  in  the  previous  two,  in  the  absence 
of  signal,  the  channel  output  is  a  sample  function  of  the  noise  narrow- 
odr.d  white  gauesian  process;  and,  in  the  presence  of  signal,  the  channel 
-.it  >ut  xS  the  sum  of  two  sample  functions  —  one  from  the  noise  and  the 
other  from  the  narrow-band  white  gaussian  signal  process.  The  signal 
and  noise  processes  are  assumed  to  be  centered  at  the  same  frequency 
and  to  have  zero  means.  The  channel  output  prior  to  its  examination 
by  the  detector  is  passed  through  a  square-law  detector  (27).  The 
probability  densities  of  the  square-law  detector  output  under  signal 
and  under  no-simM  ^onriti  'esoecfi vely,  are  (2”) 

.  JL- 

-  a„  2(l+e) 

gfi(y)  *  - -  e  ,  y  >  0  (A-3^) 

6  Ojj  2(1  +  0) 


-  0  , 


y  <  o 
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.  2L 

2 


fo(y) 


y  >  0 


(A-35) 


0  , 


y  <  0 


2  2 

where  ae  end  crw  are,  respectively,  the  signal  and  noise  mean  square 
b  H 

values  and  6  is  the  signal-to-noise  power  ratio 


The  distribution  function  under  signal  conditions  is 


(A-36) 


o6(y)  -  J  t0M  dx 


(A-37) 


Fo(-rfr) 


Differentiating,  we  obtain 


dG0(y) 


-  y  f0(y) 


(A-38) 
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Appendix  B 
LIKELIHOOD  DETECTORS 


In  this  appendix,  the  likelihood  detectors  associated  with  the 
detection  problems  treated  In  this  investigation  are  presented,  and  their 
performance  in  the  above  problems  evaluated. 

It  is  well  known  -hat  a  likelihood  detector  bases  its  decisions  on 
the  likelihood  ratio  statistic  defined  as 


‘.-TT 


(B-l) 


i=l 


where  n  is  the  number  of  independent  samples  extracted  from  the  observed 
waveform  Y(t),  and  g0(y),  f  (y)  are  the  probability  densities  of  the 
detector  input  under  signal  and  under  no-signal  conditions,  respectively. 

For  the  weak  signal  case,  and  provided  the  derivative  of  gQ(y)  with 
respect  to  6  exists  and  is  continuous  at  9  ■  0,  the  Likelihood  ratio 
statistic  is  equivalent  to 


L.  i  y  b'(yi) 

D  ‘ "  k  V*? 


(B-2  ) 


1=1 


where 


*'(y) 


d  ge(y) 

~de 


(B-3) 


e 


The  likelihood  statistic  given  in  Eq.  (B-2)  satisfies  condition  (A)-(f) 
in  the  weak  signal  case  and  for  the  problems  investigated.  Thus,  its 
performance  relation  and  output  signal- to- noise  ratio  are  given  by 
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K*e2 n  *=  2[erf-1(l-2cr)  +  erf_1(l^)]‘ 


(B-4) 


(D-es/S? 


where  the  efficacy  K*  is  (5) 


(B-5) 


(B-6) 


Hie  specific  likelihood  detectors  associated  with  each  particular 
detection  problem  and  their  efficacy  in  the  problem  are  given  below. 

B-l  Detection  of  a  Constant  in  Additive  Gaussian  Noise 

Case  I.  The  additive  noise  statistics  are  assumed  to  be  stationary. 
Thus,  the  mean  and  variance  under  no-signal  conditions  of  the  detector 
input  will  be  assumed  to  be  known,  since  they  can  easily  be  obtained  for 
a  stationary  process.  The  mean  under  no-signal  conditions  can  then  be 
subtracted  from  the  reference  and  data  waveforms,  and  the  resulting 
waveforms  divided  by  the  variance  so  the  random  variable  Y  representing 
the  amplitude  of  the  detector  input  is  normalized  to  a  N(0,  l)  random 
variable.  Eqs.  (A-2)  and  (A-4)  are  then  applicable.  Utilizing  them 
in  Eqs.  (B-2 )  and  (B-3)  we  obtain  (5) 


n 


.*  1  V 

L  *  —  >  y . 
n  n 

(B-7) 

i  =i 

* 

K  =  1 

(B-8) 

So,  for  this  case  of  known  mean  and  variance  under  no- signal  conditions, 
only  a  data  sample  is  required  by  the  likelihood  detector. 
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Case  II.  In  this  case  the  mean  under  no- signal  conditions  is  assumed 
to  be  unknown  or  quasi- stationary,  while  the  variance  under  no- signal 
conditions  is  assumed  to  be  stationary  so  that,  if  unknown,  it  can  be 
easily  obtained.  Thus,  the  input  can  be  normalized  to  have  a  variance 
of  one.  ft>r  this  case  the  probability  densities  of  the  detector  input 


are 


.  krill0,)2 

ge(y)  =  e  2 

6  Jzi 


<  y  < 


(B-9) 


_  00  <  y  <  w 


(B-10) 


where 


.  A 
6  «  - 
o 


(B-ll) 


Thus 


b'(y) 


4S 


2 


(y-M)  fQ(y) 


and  the  likelihood  ratio  statistic  is 


-  oo  <  y  < 


(3-12) 


n 


L*(K)  -  i  £  far,  -  H) 


1=1 


(B-13) 


However,  the  mean  M  is  unknown.  To  apply  the  above  statistic,  the  unknown 
mean  will  be  estimated  from  a  reference  sample  function  obtained  under 


12* 


no* signal  conditions.  The  sample  mean  M  is  chosen  as  the  estimator 
of  M. 


(B-U) 


where  is  the  value  of  the  j  sample  obtained  from  N'(t),  the 
reference  sample  function.  Utilizing  M,  the  likelihood  statistic  becomes 


(B-15) 


n  m 

"i  I  yi  •»  I 


The  mean  of  L  under  signal  conditions  is 
n 


W  - 6 


(B-16) 


and  the  variance  under  no-signal  conditions  is  given  by 


2rr*,  1  *  1 

o  L  nJ  n  m 


(B-17 ) 


Hence,  the  efficacy  of  the  likelihood  statistic  is 


*  1 
K  =  - 
n 


d  vO 

de  e=o 

ajL*) 


(B-18) 


1  +  - 
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Case  in.  Hie  mean  under  no- signal  conditions  is  assumed  to  be 
non- 8 tat ionary,  while  the  variance  is  assumed  to  be  stationary.  This  is 
a  conceivable  prcctical  situation.  Since  the  mean  is  non- stationary  and 
its  time  variation  is  unknown,  it  cannot  be  estimated;  hence,  the  likeli¬ 
hood  detector  cannot  be  employ’’ ed  if  only  one  sample  function  is  used. 
However,  if  two  channels  —  a  reference  and  a  data  channel  with 
identical  statistics  —  are  utilized,  we  may  eliminate  the  need  for 
knowing  the  mean  if  the  reference  sample  function  is  subtracted  from  the 
data  sample  function  and  a  decision  is  based  on  the  samples  extracted 
from  the  difference  waveform.  If,  in  addition,  the  difference  waveform 
is  divided  by  the  known  variance,  then  the  probability  densities  of  the 
amplitude  of  the  detector  input  Z  are  independent  of  the  time  varying 
mean,  and  are  given  by 


f 

o 


(z) 


-  oo  <  Z  <  so  (B-19) 


.tezsf 

1  2 

gg(z)  «  —  e  ,  -  » <  Z  <  »  (B-20) 

v4x 


Thus 

b'(z)  -  |  z  fQ(z) 


and 


n 


n 


-  •  1  M 

m 


fi 


i«i 


(B-21) 


1 

2 


(B-22) 


130 


B-2  Detection  of  a  Constant  in  Additive  Noise-Unspecified  Pi sv-i rations 
In  .his  general  problem  the  form  of  the  distributions  Ga(y)  and 

V 

F  (y)  are  unknown.  The  only  information  available  is  that  G.(y )  and 

O  0 

FQ(y)  obey  the  relation 

Gff(y)  =  Fo(y  -  0)  (B-23) 

Hius,  the  likelihood  ratio  statistic  cannot  be  used  in  this  case  of 
distributions  of  unknown  form.  However,  the  likelihood  ratio  statistic 
obtained  under  a  similar  gaussian  situation  can  be,  and  usually  is, 
enpl^yeu.  This  is  given  by  Eq.  (3-7). 

Case  I.  Hie  mean  and  variance  under  no-signal  conditions  are 
assumed  to  be  stationary;  hence,  they  can  be  easily  obtained  if  unknown 
and  the  detector  input  amplitude  Y  normalized,  so  that 

E  [Y]  *  0  (B-2U) 

°02m  - 1 

The  likelihood  statistic  utilized  in  this  case  is 

n 


i*=l 

with  efficacj  given  (5)  by 

K*  =  1  (B-25) 


Case  II.  The  mean  is  unknown  or  quasi- stationary  under  no- signal 
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conditions,  while  the  variance  is  assumed  stationary  and  known.  The 
detector  utilizes  the  statistic 


n  m 


(B-26) 


i=l 


>1 


Since  for  this  general  problem  g.(y)  «  f  (y-0)  we  have 

o  o 


n  m 

t 1  -  s  I 

i=l  J-1 


(B-2T) 


6  +  M  -  M 


=  e 


and 


(B-28) 


for  e’.i  input  normalized  with  respect  to  variance.  Hence,  the  efficacy  is 


* 

K 


1 


m 


(B-29) 


Case  III.  The  mean  is  non- stationary  under  no-signal  conditions, 
and  its  time  variation  is  unknown.  The  variance  is  assumed  to  be 
stationary  and  known.  The  mean  cannot  be  estimated  uncV:-  ett  d 

conditions.  Hence,  the  likelihood  detector,  ir.  order  not  -o  dc  ;enc  cn 
the  mean,  will  base  its  decision  on  measurements  made  on  the  d^  ffertnee 
between  data  and  reference  sample  functions  obtained  from  channels  of 
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Independent  but  identical  statistics.  The  difference  waveform  is  also 
normalized  so  as  to  have  variance  of  one.  Under  the  stated  conditions 

n 


(B-30) 


i«l 


where 


Z(t)  «=  Y(t)  -  N  (t) 


Since  Gn(y)  *=  F  (y-0),  we  have  that 

u  O 

Ee(z)  =  e 

and 

002(Z)  -  2 

Thus 


vO  - e 

2_  2 
°o  ■  n 


Hence  the  efficacy  is 


(B”3l) 


(B-32) 


(B-33) 


B-3  Detection  of  a  Constant  in  Additive  Combination  of  Gaussian  and 
Impulse  Noise 

This  detection  problem  is  a  specific  case  of  the  general  problem 
discussed  in  the  previous  section.  Hence,  as  stated  there,  if  the  forms 
of  the  distributions  are  not  known,  then  the  binary  integrator  of 
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Eq.  (B-7)  will  be  ueed  since,  in  the  absence  of  knowledge  concerning  the 
form  of  the  distributions,  the  likelihood  ratio  statistic  obtained  under 
the  gsussian  assumption  is  usually  employed.  The  efficacies  of  the 
statistic  for  the  present  detection  problem  are  those  given  by  Eqs .  (B-25)> 
(B-29)  and  (B-33). 


B-4  Detection  of  a  Sine  Wave  of  Unknown  Riase  in  Additive  Gaussian  hoi  sc 
Case  I.  The  mean  and  variance  under  no- signal  conditions  are  assumed 
stationary  and  known,  fbr  this  case  the  likelihood  ratio  statistic  and 
its  efficacy  are  given  (16)  by 


n 


i*l 


(B-34) 


end 


* 


K  *  2 


(B-35) 


Case  II.  The  mean  under  no- signal  conditions  is  assumed  to  be 
non- stationary,  while  the  variance  is  assumed  stationary  and  known.  In 
this  case,  as  stated  previously,  the  likelihood  detector  will  base  its 
decisions  on  measurements  made  on  Z(t),  the  difference  between  the  data 
and  reference  sample  functions  normalized  to  have  unit  variance.  Thus, 
the  amplitude  Z  of  the  detector  input  is  given  by 

Z  «  Y  -  X  (B-36) 

where  Y  and  X  are  il*  amplitudes  of  the  data  and  reference  channel 
outputs.  Since  Y  and  X  are  assumed  cc  ce  independent,  the  probability 
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densities  of  Z  under  signal  and  under  no- signal  conditions  are 


00 


(z)  =  J  g0(y)  f0(y-z)  <3y 

•00 

(B-37) 

00 

(z)  =  J  f0(y)  f0(y-z)  dy 
-00 

(B-30) 

Utilizing  Eqs •  (A-9)  and  (A-13)  we  obtain 


00 

r  ,  2 


fc'U)  =  J  (y  -  1)  f0(y)  fQ(y-z) 


(B-39) 


■Kt-  Ofo<2)> 


-  “»  <  Z  <  00 


Thus,  the  likelihood  ratio  statistic  and  its  efficacy  are 


■5-iIC-t--*) 

1=1 


(B-40) 


and 


*  1 

K  =5 


(B-M) 


B-5  Envelope  Detection  of  a  Sine  Wave  in  Narrow-Band  Gaussian  Noise 
Case  I.  The  assumptions  for  this  case  are  the  same  as  those  made 
in  Case  I  of  Section  B-4 .  The  likelihood  ratio  statistic  and  its  efficacy 
are  giver.  (5)  by 


n 


i=l 


(B-U2) 
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K  - 


1 


(B-U3) 
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Case  II.  Die  assumptions  are  the  same  as  those  made  in  Case  II  of 
the  previous  section.  Hence,  for  the  difference  envelope  random  variable 
V,  utilizing  Eqs.  (A-15)  and  (A-l6)  we  have 


g-(v) 


v  >  o 


*  o  > 


V  <  o 


(B-44) 


f0(y) 


-  0  > 


v  >  o 

(B-45) 

V  <  o 


Hence 


b'(v) 


(B-4 6) 


and  the  likelihood  ratio  statistic  and  its  efficacy  are 
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n  y  c 

■C-ilK+-0 


i-1 
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(B-47) 


(B-48) 


B -6  Square -Lav  Detection  of  a  Sine  Wave  in  Narrow- Band  Gaussian  Noise 

Case  I.  The  assumptions  here  are  those  stated  in  Section  B-2,  Case  I. 
The  probability  densities  under  signal  and  under  no- signal  conditions  are 
given  by  Eqs.  (A-20)  and  (A-2l),  respectively.  Hence 

b'(y)  =  (y  -  l)  e"y  ,  y  >  o 

(B-49) 

*=  o  ,  y  <  o 
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Ibus,  the  likelil.ood  ratio  statistic  is 

•  i  r  b'<yi} 

“  '  n  L  *,1^ 

1*1  °  1 

*  n  I  (yl  ‘  15 

i*l 


(B-50) 


The  efficacy  is 


K*  =  J  (y  -  l)2  fQ(y)  dy 
*  1 


(B-51) 


Case  II.  The  assumptions  and  discussion  in  connection  with  Case  II 
of  Section  B-4  pertain  here  also.  Utilizing  Eqs.  (A-20)  and  (A-21)  we 
obtain  the  probability  densities  of  the  square-law  envelope  V  of  the 
difference  waveform  z(t).  These  are 


ge(v) 


=  o  , 


V  >  o 

(B-52) 

V  <  o 


t0(v) 


*  o  , 


V  >  o 

(B-53) 

V  <  0 


Hence 

b'(v)  =  |  (v  -  l)  fQ(v) 


(B-54) 
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and  the  statistic  and  Its  efficacy  are 


n 


(B-55) 

i«l 

*  1 

K 

(B-56) 

B-7  Detection  oi‘  Nerrow-Band  White  Gaussian  Signal  in  Additive  Harrow- 

Band  White  Gaussian  Noise 

Uhls  problem  Involves  the  detection  of  a  stochastic  signal  in  noise; 
hence ,  the  information  on  the  presence  or  absence  of  the  signal  Is  carried 
by  the  scale  parameters  of  the  distributions.  In  fact,  the  decision  on 
the  presence  or  absence  of  signal  la  based  on  the  difference  between 
the  variance  under  signal  and  under  no- signal  conditions.  Location 
parameters  such  as  the  mean  carry  no  Information.  Thus,  in  the  detection 
of  stochastic  signals  in  noise,  if  the  means  under  signal  or  under  no- 
algnal  conditions  or  under  both  are  unknown  or  non- stationary,  they  may 
be  subtracted  out  of  the  channel  output  by  capacitive  filtering.  In  this 
manner  the  amplitude  of  the  channel  output  will  be  the  same  stationary 
mean,  namely  zero,  under  signal  and  under  no- signal  conditions,  and  a 
difference  between  the  distributions  0o(y)  and  F  (y)  can  be  attributed 
to  a  difference  in  variance  and,  hence,  to  the  signal.  In  this  and  the 
following  problems,  the  channel  output  will  be  assumed  to  have  been 
subjected  to  capacitive  filtering  prior  to  being  predetection  processed 
or  prior  to  its  examination  by  the  detector. 

U3C  of  Eq.  (A-24- )  yields 

V(y)  -£  (y2  -  i)  f0(y) 


(B-57) 
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where  fQ(y)  given  by  Eq.  (A-25)-  Hius,  the  likelihood  ratio  statistic 

is 


(B-58) 


which  is  a  square-law  summing  or  energy  device.  Hie  efficacy  of  the 
statistic  is 


K*  -  \  J  (y2  -  l)2  f0(y)  dy  (B-59) 


B-8  Envelope  Detection  of  Narrow-Band  White  Gaussian  Signal  in  Additive 
White  Gaussian  Noise 


From  Eq.  (A-29)  we  obtain 

V(y)  -  -  i;f0(y) 


(B-60) 


thus,  the  likelihood  statistic  is 


i-1 


(B-61) 


which  is  an  energy  summing  device  as  in  the  previous  case.  The  efficacy 


of  the  statistic  is 


l?s 


2  2 

K*  *  J  -  1  )  f0(/)  dy  (B-S2) 

that  is,  twice  the  efficacy  obtained  when  the  energy  detector  is  used 
without  envelope  predetection  processing. 

B-9  Square -Law  Detection  of  Narrow-Band  White  Gaussian  Signal  in 
Additive  Harrow-Band  White  Gaussian  Boise 

From  Eq.  the  quantity  b’(y)  for  this  problem  is  obtained. 

It  is 


b*  (y)  *  (y  -  l)  fQ(y) 

thus,  the  likelihood  statistic  is 


(B-63) 


n 


i-1 


which  Is  a  simple  summing  device. 


efficacy  of  the  statistic  is 


* 

K 


f*0(y)  <*y 


(b-64) 


the  same  as  that  obtained  by  envelope  predetection  processing  the  input 
waveform  and  using  an  energy  detector. 


